A diagnosis assisting apparatus includes a display, an imaging unit configured to image a subject, a line of sight detecting unit configured to detect a line of sight direction of the subject from a picked-up image imaged by the imaging unit, a point of view detecting unit configured to detect a point of view of the subject in a display region of the display based on the line of sight direction, and an output controller configured to display a diagnostic image including a natural image and a geometrical image, and the point of view detecting unit detects the point of view of the subject in a case where the diagnostic image is displayed.