An image processing apparatus includes an input unit which receives, from an image capturing apparatus, moving image data in which the shadow of a foreign substance adhered to the surface of an optical member is captured, an obtaining unit which obtains, from the moving image data, foreign substance information including information of the position and size of the foreign substance captured in the moving image data, a playback unit which can play back the moving image data while correcting the shadow of the foreign substance in the moving image data by using the foreign substance information, a display unit which displays an image played back by the playback unit, and a setting unit which sets, in accordance with the playback status of the moving image data, whether to perform processing of correcting the shadow of the foreign substance in each frame of the moving image data.