An image processing apparatus comprising a first detection unit configured to detect a first area in an image of an image signal output from an image pickup element, a second detection unit configured to detect one or more second areas each corresponding to an eye included in the first area in the image, a specification unit configured to receive an area specification instruction by a user operation and to specify one area in the image, and a setting unit configured to set an object corresponding to the area specified by the specification unit to be focused on, wherein, in a case where the first area is detected by the first detection unit, the specification unit receives specification of the eye in an area based on the first area regardless of a detection result of the second areas.