A vehicle control device includes a storage device and a processor. The storage device is configured to store relationship prescription data that prescribe a relationship between a state of a vehicle and an action variable that is a variable related to an operation of an electronic device in the vehicle. The processor is configured to calculate a reward corresponding to the operation of the electronic device. The processor is configured to update the relationship prescription data using, as inputs to updated mapping determined in advance, the state of the vehicle that is based on a detection value that is acquired, a value of the action variable that is used to operate the electronic device, and the reward corresponding to the operation of the electronic device when a computation load on the processor is equal to or less than a predetermined load.