A system and method that provide full color mapping of video images with minimal distortion to the image. A two-dimensional look up table may be used to map a certain number of colors, and for colors that are not represented by entries in the table, the four closest entries to the desired color may be interpolated to provide mapping for the color, thus achieving full color mapping. The method may also provide the ability to map colors in partial bypass and full bypass conditions. In a full bypass condition the color goes through the system unchanged, and the system may be capable of mapping the brightness of the color by interpolating the luminance values of the closest table entries.