A warning control device includes a control device configured to identify a viewing direction of a driver based on a captured image including a face of the driver, detect, based on the viewing direction, distractedness that the driver views a direction different from a front side of a vehicle for a certain period of time or longer, in a case the distractedness of the driver is not detected, accept an operation on an operation member disposed inside the vehicle, and control a display to display an image based on the operation accepted, and in a case the distractedness of the driver is detected, and control the display to display a warning image for warning that the driver is not attentively viewing the front side.