Systems and methods for segmenting an image into at least two layers, a foreground and a background layer include rough labeling or segmenting at least a portion of the image into foreground and background pixels. The rough labeled pixels may be refined by using local classifications. Additional processes may be performed on the image including, but not limited to, filtering, image enhancing, shape refining, image compression, etc.