An image processing apparatus which enables to suppress coloring in an image after image recovery processing, and a control method for the image processing apparatus are disclosed. After the chromatic difference of magnification of an optical imaging system is corrected, a first value relating to coloring is obtained before application of an image recovery filter. Then, an image recovery filter which, preferably, does not correct a chromatic difference of magnification and is based on a function indicating the aberrations of the optical imaging system is applied. A second value associated with coloring is obtained from the image after application of the image recovery filter. According to the difference between the first and second values obtained before and after application of the image recovery filter respectively, pixel value correction for correcting coloring is performed.