An image processing apparatus includes: a distance calculation unit configured to calculate distance information on the basis of a first image and a second image; and a blur addition unit configured to add a blur to original images based on the first image and the second image, using the distance information calculated by the distance calculation unit and to move a focus plane by a predetermined refocus distance. The blur addition unit adds the blur to a first original image when the refocus distance is equal to or less than a threshold and adds the blur to a second original image, which is an image having an effective F-number greater than an effective F-number of the first original image, when the refocus distance is greater than the threshold.