An image processing apparatus includes a defined binary image generating unit configured to generate a defined binary image associated with a level image, which is associated with an input image, the level image having pixel values of pixels represented using a first value, by regarding a pixel as a defined or undefined region pixel and setting the pixel to have a predetermined second or third value; and an estimated foreground color image generation unit configured to generate an estimated foreground color image associated with the input image, by setting the pixel values of the pixels regarded as the undefined region pixels in the defined binary image to pixel values of pixels in the input image corresponding to pixels for which distances each obtained from an integrated value of the amounts of change in continuity information are shortest from among the pixels that are regarded as the defined region pixels.