Systems and methods are provided for associating colors or color names with a color image based on hue. A set of hue values can be extracted from color data, such as a color palette, corresponding to a color image. A representative hue can be derived from the set of hue values. Colors included in the color data that are attributable to the representative hue can be identified and one or more colors can be derived therefrom as representative of a subject depicted by the color image. Color names matching the representative colors can be identified and associated with the color image. In particular, a common color name can be determined therefrom and associated with the subject of the color image.