An image processing apparatus, an image processing method, and a program, provide accurate collation even when an image contains a number of identical or similar subjects. The image processing apparatus generates, with respect to feature points to be detected from a first image, a first local feature amount group including local feature amounts representing feature amounts of local regions containing the respective feature points, and a first coordinate position information group including coordinate position information. The image processing apparatus clusters the feature points of the first image based on the first coordinate position information group. The image processing apparatus collates, in units of clusters, the first local feature amount group with a second local feature amount group formed from local feature amounts of feature points detected from a second image.