An image processing apparatus includes a holding unit configured to hold, for each combination of a first angle indicating a face direction of a first face image which includes a human face and a second angle indicating a face direction of a second face image which includes a human face, a learning dictionary including information related to positions of feature points associating the first and second face images when a similarity degree between the first and second face images is estimated, a selection unit configured to select the learning dictionary held for each combination in accordance with the combination of the first and second angles, and a similarity degree estimation unit configured to estimate a facial similarity degree between the first and second face images on the basis of feature amounts extracted from the face images corresponding to the positions of the feature points included in the selected learning dictionary.