An image processing device includes: a detection unit detecting a movement amount of an image between first image data constituting image data generated by an image capturing element provided with a plurality of image generating pixels generating pixel values for generating an image and a plurality of pairs of phase difference detecting pixels generating pixel values for performing focusing determination by phase difference detection, and second image data subsequent to the first image data on a time axis, wherein the movement amount is a movement amount of one phase difference detecting pixel when a defective pixel included in the pair of phase difference detecting pixels is one of the pair; and a correction unit correcting the pixel value of the defective pixel in the second image data on the basis of the detected movement amount and the pixel value of one phase difference detecting pixel in the first image data.