An image processing apparatus includes a first defect interpolation unit that interpolates a defective pixel using a pixel value of a first pixel near a specific first pixel or a pixel value of a second pixel near a specific second pixel, a second defect interpolation unit that interpolates the defective pixel using a rate of pixel values of a first pixel and a second pixel in the same micro lens near the specific first pixel and the specific second pixel, an in-focus level evaluation unit that evaluates an in-focus level using outputs of the first and second pixels, a synthesis rate switching unit that switches a synthesis rate of outputs of the first and second defect interpolation units, and a signal processing unit that generates a shot image using an output of the synthesis rate switching unit.