The image-pickup apparatus includes an image-pickup element including first type pixels photoelectrically converting an object image formed by a light flux from an optical system and second type pixels photoelectrically converting plural images formed by plural light fluxes divided from the light flux from the optical system, a controller performing contrast detection focus control using signals from pixels in a contrast evaluation area among the first type pixels, and a detector detecting phase differences of respective pairs of images of the plural images using signals from the second type pixels, the pairs of images being respectively formed in plural phase difference detection areas in the contrast evaluation area, and calculating information on an in-focus position of the optical system or object distance for each phase difference detection area based on each phase difference. The controller changes the contrast evaluation area based on the information calculated for the respective phase difference detection areas.