The image processing apparatus includes a gradient calculating part calculating intensity gradient at each pixel in a captured color image, a first color blur determining part determining that a pixel at which the intensity gradient satisfies a color blur condition using a first threshold is a possible color blur pixel, and a second color blur determining part detecting a saturated pixel in the color image, and determining, when a distance between the saturated pixel and the possible color blur pixel is within a second threshold, that the possible color blur pixel is a color blur pixel. The first and second color blur determining parts change the first and second thresholds depending on at least one of luminance and chroma of the possible color blur pixel.