The color remapping system places axes on the Cb-Cr color plane to differentiate and isolate colors of interest. Each axis has a programmable position, hue change value and saturation change value. Input pixels from the video data stream are calibrated with respect to the axes and enhanced based upon the two neighboring axes adjacent to the input pixels. The system can be reconfigured in real time by repositioning the axes and changing their hue and saturation change values. The system is easy to program and reconfigure and provides visually pleasing enhancements to the digital video.