Provided are an image processing apparatus and method for counting moving objects in an image, the apparatus including: a motion detection unit which detects motion in an image; an object detection unit which detects objects based on the motion detected by the motion detection unit; an outline generation unit which generates at least one reference outline of which a size is adjusted according to a preset parameter based on a location in the image; and a calculation unit which calculates a number of objects having substantially a same size as that of the at least one reference outline from among the objects detected by the object detection unit, wherein the preset parameter is adjusted according to at least one circumstantial parameter.