To improve a search accuracy in template matching based on a coarse-to-fine search method, a first pyramid is generated by hierarchizing a plurality of template images having different resolutions from each other in order of the resolution, a second pyramid is generated by hierarchizing a plurality of search target images having different resolutions from each other corresponding to the same resolutions as the template images in the first pyramid in order of the resolution, and a search process of searching for a feature image included in the template image of the first pyramid from the search target image in the second pyramid in a hierarchy of the same resolution. When the first pyramid is generated, the number of stages of the first pyramid is set such that a size of the feature image included in each of the template images is not smaller than a previously set threshold.