Source image data is subjected to a logarithmic process (gamma correction process) (S11), and the luminance distribution of source image data is acquired (S12). Then, it is determined whether or not the luminance distribution of source image data corresponds to “a high luminance scene (highlight scene) biased toward a high luminance side” based on a characteristic of a luminance value equal to or greater than a first threshold value in the luminance distribution of source image data (S13). According to the determination result (Y/N of S13), a restoration process based on a point spread function of an optical system is controlled (S14, S15). A restoration filter which is used in the restoration process has a filter coefficient corresponding to image data before the logarithmic process.