A hardness tester that measures a size of an indent to determine the hardness of a sample. The hardness tester includes an imaging unit, a display unit, a pointing device and a position adjustment unit. The imaging unit takes an image of a surface of the sample. The display unit displays a surface image of the sample and a cursor. The pointing device receives a first instruction instructing a movement of the surface image of the sample appearing on the display unit through a movement of the cursor, and a second instruction instructing a change in a height of the sample stage through a movement of the cursor. The position adjustment unit moves the sample stage in a horizontal direction and in a vertical direction.