A vehicle control device includes: a speech acquiring section that acquires speech data related to a speech of a speaker; a state acquiring section that acquires information indicating whether or not a driver attempting to start driving a vehicle is in an intoxicated state based on the speech data; and a control section configured to limit a start operation of the vehicle in a case in which the information indicates that the driver is in the intoxicated state, the start operation being an operation performed by the driver with respect to the vehicle to start driving the vehicle.