An object tracking system that includes a sensor that is configured to capture frames of at least a portion of a global plane for a space. The system further includes a position sensor that is configured to output (x,y) coordinates corresponding with the physical location of the sensor within the space. The system is configured to receive an (x,y) coordinate within the space for the sensor from the position sensor. The (x,y) coordinate corresponds with a new physical location of the sensor within the space. The system is further configured to determine translation coefficients for the sensor based on a difference between the (x,y) coordinate and a previous (x,y) coordinate for the sensor. The system is further configured to update a homography associated with the sensor by applying the translation coefficients to the homography and to store the updated homography.