A system and method for ocular stabilization of video images is disclosed. While capturing video images in a forward field of view with a forward-facing video camera of a wearable head-mountable device (HMD), binocular eye-gaze directions of left and right eyes of a user of the HMD may be obtained with an eye-tracking device of the HMD. Based on the obtained binocular eye-gaze directions of left and right eyes of the user of the HMD, convergent gaze directions of the user may be determined as a function of time during an interval concurrent with the capturing of the video images. The captured video images may then be stabilized by compensating for motion of the forward-facing video camera with an intersection of the convergent gaze directions of the user with an image plane of the forward-facing video camera.