Image processing is performed in view of the difference between the chroma component and the brightness component in an image, with a relatively smaller amount of data processed during the image processing. A frequency decomposing unit 110 performs frequency decomposition directly on Bayer image signals from an imaging element 3. With this, a high frequency component representing color information and a low frequency component representing brightness information are obtained. A filter coefficient obtaining unit 131 of a correction processing unit 130 obtains filter coefficients and the filter coefficients for the high frequency component are different from those for the low frequency component. A filtering processing unit performs a filtering process on subimages based on the filter coefficients obtained by the filter coefficient obtaining unit 131 in such a manner that processing details of the filtering process for the high frequency component are different from those for the low frequency component.