An image processing apparatus includes: a representative value calculation unit that selects a designation area from a first image, and that calculates a representative value of each of the color components in the designation area, a class classification unit that performs class classification on the designation area, a coefficient reading unit that reads a coefficient that is stored in advance, a color component conversion unit that sets the pixel value relating to a predetermined pixel within the designation area to be a prediction tap, sets the pixel value of one color component, to be a reference, and converts the pixel value of each color component into a conversion value, and a product and sum calculation unit that sets the conversion value to be a variable and calculates each of the pixel values of a second image, by performing product and sum calculation which uses the coefficient which is read.