An image pickup apparatus which can perform an AF of a high speed and a high focusing precision by simultaneously realizing a phase difference AF and a contrast AF, decides arrange where a contrast evaluation can be performed on the basis of a correspondence relation between each pixel of an image pickup element which is restricted by pupil division means provided for restricting light of an optical image of an object which enters each pixel of the image pickup element to light from a specific exit pupil area of a photographing lens and the specific exit pupil area of the photographing lens, and decides a focus evaluation value of the object in accordance with the decided range from a contrast focus position or a correlation focus position.