A method and system is provided for segmenting scanned image data in accordance with mixed raster content processing for more efficient processing of non-uniform color page borders. A first processing method partitions the border so that resulting segments can be coded efficiently by cutting the border into segments along cut lines disposed in optimum position for minimizing a total area of bounding boxes for the page border segments. Another embodiment determines the color variance within the page border window and compares the variance against predetermined color variance threshold. A window width of the page border window is also determined and compared with a predetermined width threshold. When the variance and window widths are smaller than the thresholds, a uniform color is assigned to the non-uniform color page border and the border is coded in accordance with a foreground layer compression algorithm.