A template-matching apparatus includes a first calculating unit calculating a first characteristic amount from the image information of a template image, and extracting unit extracting a partial image, a second calculating unit calculating for image information of the partial image a second characteristic amount, a third calculating unit calculating a residual amount from the image information of the template image and the partial image, a first computing unit finding a first degree of similarity, a second computing unit that finds a second degree of similarity based on the residual amount, a third computing unit finding a third degree of similarity based on the first and second degree of similarity, and a specifying unit specifying a matching position, thereby specifying the matching position with good accuracy even if the input image is observed with some geometrical change.