An image processing apparatus MFP includes a memory for storing color data of a plurality of picture elements together with a correlation to identification information for identifying each picture element, and storing a reference value and a statistical value for each of a predetermined number of baskets; a classifying unit for classifying each of the plurality of picture elements into one of the baskets based on the color data and the reference value corresponding to the basket; a calculating unit for calculating the statistical value and the reference value of the basket accommodating the classified picture element based on the color data corresponding to the picture element; and a determining unit for determining a representative color of each basket based on the statistical value, and outputting the representative color of each basket and a result of the classification of each picture element.