A vehicle control device includes a memory configured to store relationship definition data that defines a relationship between a state of a vehicle and an action variable, which is a variable relating to an operation of electronic equipment in the vehicle, and a processor. The processor is configured to execute acquisition processing of acquiring a detection value of a sensor and driving preference information, operation processing of operating the electronic equipment, reward calculation processing of providing a greater reward when a characteristic of the vehicle satisfies a criterion than when the characteristic of the vehicle does not satisfy the criterion, and update processing of updating the relationship definition data. The processor is configured to, based on update mapping, output the relationship definition data updated to increase an expected return on the reward when the electronic equipment is operated in compliance with the relationship definition data.