A method for color transfer includes retrieving a concept color palette from computer memory corresponding to a concept selected by a user. The concept color palette includes a first set of colors, which may be statistically representative of colors of a set of predefined color palettes which have been associated with the concept. The method further includes computing an image color palette for an input image. The image color palette includes a second set of colors that are representative of pixels of the input image. Colors of the image color palette are mapped to colors of the concept color palette to identify, for colors of the image color palette, a corresponding color in the concept color palette. A transformation is computed based on the mapping. For pixels of the input image, modified color values are computed, based on the computed transformation, to generate a modified image.