An image signal is resolved into a plurality of frequency components whose spatial frequencies are different from each other; a variation component of the image signal is extracted based on each of the plurality of frequency components, an absolute value of the variation component being smaller than a predetermined reference value; a level difference amount of the image signal is calculated based on the extracted variation component; and the calculated level difference amount is subtracted from the image signal.