When the user sets an AF frame such that an object tracked as an AF target is in the AF frame, an auto-tracking process starts to detect a face image from the image captured by a television camera. Then, it is determined whether the face image is detected from the peripheral range of the AF frame. If it is determined that the face image is detected from the peripheral range of the AF frame, the position of the AF frame is changed on the basis of the position of the face image. On the other hand, if it is determined that the face image is not detected from the peripheral range of the AF frame, a pattern matching process is performed. The position of the AF frame is changed to the position of the object, which is a tracking target, detected by the pattern matching process.