A method for performing automatic stereo measure of a selected point in a scene. A sensor image is initially obtained from a sensor providing an image of a scene. First and second reference images of the scene that are a stereo pair of images are also provided. The sensor image is registered with the first reference image and a point of interest is selected from one of the sensor or first reference images. A stereo point measurement using the selected point and the two reference images is performed to determine a point in the second reference image that represents a stereo mate of the selected point in the first reference image. An analysis of a three dimensional grid volume centered about the selected point in the first reference image is then performed. The analysis uses both reference images, the selected point and its stereo mate to determine the three dimensional coordinates of the point in the grid that best matches the location of the stereo mate point in the second reference image.