A medical image handling system includes a monitor for displaying a medical image, an input device for inputting an image reading report corresponding to the medical image displayed on the monitor, and a processor. The processor judges the presence or absence of an image reading report corresponding to the medical image displayed on the monitor, and restricts a change of the medical image in a case where the image reading report is judged as being absent.