A solar power generation control device, controlling a solar power generation system configured to charge a power storage device of a vehicle with electric power generated by a solar cell provided in the vehicle, includes: a determination unit configured to determine whether irradiation light to the vehicle is sunlight based on an output of an optical sensor; and a control unit configured to control an operation mode of the solar power generation system, including a first mode, in which the power storage device is charged with electric power generated by the solar cell, and a second mode, in which power consumption of the solar power generation system is lower than in the first mode, based on a determination result of the determination unit. The control unit sets the solar power generation system to the first mode when the determination unit determines that the irradiation light is sunlight.