In general, this disclosure relates to processing techniques for processing images captured by an image capture device. More particularly, the techniques relate to automatic color removal in digitally captured images. In accordance with this disclosure, an image processing apparatus dynamically determines whether a color component of an image is likely to be considered important by a human viewer based on color information associated with the image, and removes at least a portion of the color component of the image during image processing when it is not likely to be considered important.