Systems and methods are provided for generating color names for colors corresponding to images and/or palettes. A color image is obtained, and one or more color palettes corresponding to the color image are identified. The color palette may be generated based on palette generation criteria, which may facilitate or control a palette generation process. Illustratively, the palette generation process may include image pre-processing, color distribution generation, representative color identification, palette candidate generation, and palette determination. A color name for each color identified in the color palette and/or the color image can be identified based at least in part on color name popularity information. Color name popularity information may be identified from color name-related voting results provided by a social network site. Aspects of the disclosure are further directed to processing the identified color name(s), such as updating color name metadata associated with the original color image and/or the color palette.