Disclosed are a method and an apparatus for determining displacement information of a target area by using information that is present in an image frame. The method of determining displacement information according to an embodiment of the present disclosure may include: setting a target area in which an object that displacement information determination thereof is required is positioned within a target frame; determining a tracking area in a tracking frame based on displacement information of at least one neighboring target area that is positioned around the target area; and determining a matching area that matches with the target area in the tracking area and determining the displacement information of the target area.