A visually-distracted-driving detection device that can detect visually distracted driving with high accuracy. The visually-distracted-driving detection device includes a visually-distracted-driving determination unit that determines that a driver is visually distracted if the direction in which the driver is looking is greater than or equal to a predetermined angle with respect to the front of the driver; and a prohibition unit that, if it is specified that the present position of the vehicle as specified by a present-position specifying unit is within a first predetermined distance from an intersection, prohibits a process that is performed in cases where it is determined that the driver is visually distracted.