An imaging apparatus includes an imaging plane phase-difference type first focus detecting unit and a contrast type second focus detecting unit. A saturation detecting unit detects saturation of focus detecting pixels or imaging pixels provided in an imaging element. A brightness detecting unit detects the brightness of an object. If the number of pixels detected by the saturation detecting unit exceeds a predetermined value or the brightness of an object detected by the brightness detecting unit is less than a predetermined value, a CPU controls a focus adjustment operation only using a first detection amount. Alternatively, the CPU controls a focus adjustment operation based on the result obtained by weighting processing of a first detection amount and a second detection amount in response to an increase in the number of pixels of which saturation of the outputs has been detected or a decrease in the brightness of an object.