A method for removing unwanted form color content from a scanned document by segmenting the image into two or more tiles (14). Each tile (14) is classified into at least a first and second set according to its combination of background and color content. A background color is identified from the first set of tiles (14). At least one form color is identified from the second set of tiles. A transform is applied that shifts form color image data values toward background color data values.