Aspects of the disclosure relate generally to determine specularity of an object. As an example an object or area of geometry may be selected. A set of images that include the area of geometry may be captured. This set of images may be filtered to remove images that do not show the area of geometry well, such as if the area is in a shadow or occluded by another object. A set of intensity values for the area are determined for each image. A set of angle values for each image is determined based on at least a direction of a camera that captured the particular image when the particular image was captured. The set of average intensities and the set of angle values are paired and fit to a curve. The specularity of the area may then be classified based on at least the fit.