Reference free tracking of position by a mobile platform is performed using images of a planar surface. Tracking is performed optical flow techniques, such as pyramidal Lucas-Kanade optical flow with multiple levels of resolution, where displacement is determined with pixel accuracy at lower resolutions and at sub-pixel accuracy at full resolution, which improves computation time for real time performance. Periodic drift correction is performed by matching features between a current frame and a keyframe. The keyframe may be replaced with the drift corrected current image.