When sensing an image using an image sensor driven by the rolling shutter method, a shake of an image sensing apparatus in the exposure period of the image sensor is detected, and the temporal characteristic of the detected shake is obtained. For the temporal characteristic of the shake, the frequency distribution of the distortion amount of an object image that is generated in the image owing to the shake is analyzed. For at least the center frequency, the temporal characteristic of the shake is compensated for to eliminate a phase shift generated when the temporal characteristic of the shake is obtained. An object image distortion arising from the shake for each line of the image sensor is corrected using a correction amount calculated from the compensated temporal characteristic of the shake.