An image processing apparatus comprises an image acquisition unit configured to acquire an image, an evaluation value acquisition unit configured to acquire an evaluation value of the image, a reliability acquisition unit configured to acquire reliability of the evaluation value, an evaluation unit configured to evaluate the image based on the evaluation value; and a recording unit configured to add a rating result of the image to the image and record the rating result, wherein the evaluation unit performs rating in accordance with the evaluation value excluding an evaluation value the reliability of which is relatively low.