An example method for stabilizing images involves obtaining an image of an environment from a perspective of the robot. The method also involves receiving one or more depth measurements. The depth measurements correspond to locations within the image. The method further involves determining first boundaries around a particular location within a section of the image. The particular location is approximately centered within the first boundaries. Additionally, the method involves determining an extent of deviation of a particular position of the image capture device from a reference position. The particular position is a position of the image capture device at a point in time at which the image was captured. Further, the method involves determining second boundaries by shifting the first boundaries by an amount proportional to the determined extent of deviation. The method additionally involves providing, to a display device, a portion of the image defined by the second boundaries.