An object area tracking apparatus has: a face detection unit for detecting a face area on the basis of a feature amount of a face from a supplied image; a person's body detection unit for detecting an area of a person's body on the basis of a feature amount of the person's body; and a main object determination unit for obtaining a priority for each of the objects by using detection results by the face detection unit and the person's body detection unit and determining a main object of a high priority, wherein for the object detected only by the person's body detection unit, the priority is changed in accordance with a past detection result of the object in the face detection unit.