An object tracking apparatus is configured to determine, according to a predetermined object region containing an object in an initial image of an image sequence, an object region estimated to contain the object in each subsequent image of the image sequence. Moreover, the object tracking apparatus is allowed to adapt the size of the object region obtained through tracking to the change in the shape or size of the object, and to avoid a tracking error.