Provided are a system and method for determining a color of a foreground and a computer readable recording medium therefor. The system includes: at least one processor configured to implement a motion detector which detects a motion region from an image; and a color determiner which determines the color of the foreground in the motion region based on a difference between colors of the motion region and colors of a surrounding region of the motion region, for displaying the determined foreground color with the foreground at a display device.