A method and apparatus for recognizing a gesture in an image processing system. In the apparatus, an input unit receives an image obtained by capturing a gesture of a user using a camera. A detector detects a face area in the input image, and detects a hand area in gesture search areas. The gesture search areas being set by dividing the image into predetermined areas with reference to a predetermined location of the detected face area. A controller sets the gesture search areas, determines whether a gesture occurs in the detected hand area, and selects a detection area with respect to the gesture to generate a control command for controlling an image device. A calculator calculates skin-color information and differential-area information for checking a gesture in the detected hand area. Accordingly, a hand area can be accurately detected, and a gesture can be separated from peripheral movement information, so that mal-functioning caused by gesture recognition can be reduced.