The present invention relates to image processing apparatus and method, a recording medium, and a program for providing reliable tracking of a tracking point. When a right eye 502 of a human face 504 serving as a tracking point is tracked in a frame n−1 and when a tracking point 501 appears as in a frame n, the tracking point 501 continues to be tracked. When, as in a frame n+1, the right eye 502 serving as the tracking point 501 disappears due to the rotation of the face 504 of an object to be tracked, the tracking point is transferred to a left eye 503, which is a different point of the face 504 serving as the object including the right eye 502. The present invention is applicable to a security camera system.