A method and device for automatically identifying a point of interest (e.g., the deepest or highest point) on the surface of an anomaly on a viewed object using a video inspection device is disclosed. The video inspection device obtains and displays an image of the surface of the viewed object. A reference surface is determined along with a region of interest that includes a plurality of points on the surface of the anomaly. The video inspection device determines a depth or height for each of the plurality of points on the surface of the anomaly in the region of interest. The point on the surface of the anomaly (e.g., having the greatest depth or height) is identified as the point of interest. A profile of the object surface at the point of interest is then determined.