An information handling system operating a predictive simultaneous localization and mapping (SLAM) system may comprise a camera mounted to a wearable headset capturing an image of a landmark, a positional sensor mounted to the wearable headset measuring a current positional state of the headset, and a network adapter receiving a stored SLAM frame, including an identification and position of the landmark within a previously captured image. A processor executing code instructions of the predictive SLAM system may generate a current SLAM frame based on the image captured via the camera, determine a Kalman gain associated with an observed location of the landmark based on the current SLAM frame and the stored SLAM frame, and determine a corrected position of the wearable headset based on a previously measured positional state of the headset, the current positional state of the headset, the current SLAM frame, and the Kalman gain.