An idling stop control device includes an authenticator, a storage, a getting-off detector, and an engine restart permitter. The authenticator is installed in a vehicle, performs authentication via a wireless communication with a mobile device, and repeatedly performs, while the vehicle travels, an authentication operation at predetermined intervals. The storage stores result and time of authentication as the authentication history during travel. The engine restart permitter determines permission or prohibition of restart of the engine in accordance with the authentication history and getting-off information, permits restart of the engine when the authentication is successful and permits, in a case where the authentication fails, restart of the engine when a history of success of authentication has been stored in the storage during travel and the getting-off is not detected after the authentication has been successful.