A comparison system includes a portable terminal including image capturing unit configured to capture a comparison image of a predetermined comparison region of a comparison object; and a server including comparison unit configured to compare the comparison object with a registered object on the basis of a statistical value for the luminance value of pixels in a registered image of the registered object, the pixels of the registered image existing at pixel positions corresponding to pixel positions estimated to be generating specular reflection in the comparison image captured by the portable terminal.