The present invention provides an image processing device, an image processing method, and a program capable of suppressing the calculation load of processing of enhancing mutually different resolutions for each of a sagittal direction and a tangential direction of a lens. In the aspect of the present invention, the image processing device 35 includes: an image acquisition section 40 that acquires a first image which is acquired from an imaging element by imaging a subject image using an optical system; a second image generation section 41 that generates a second image which is developed as a panorama by performing polar coordinate transformation on the first image acquired by the image acquisition section; and a resolution enhancement processing section 42 that performs resolution enhancement processing on the second image asymmetrically in a horizontal direction and a vertical direction of the second image.