A vehicle control system includes a vehicle control apparatus mounted on a vehicle for controlling the vehicle, an electronic key carried by a user for performing communication with the vehicle control apparatus, and a portable device carried by the user for performing communication with the electronic key. When detecting user's getting in or out of the vehicle, the vehicle control apparatus determines a location of the electronic key based on communication with the electronic key. When the location of the electronic key is in the vehicle and the user has no intention of getting out of the vehicle, communication between the electronic key and the portable device is brought into a connected state. When the location of the electronic key is outside the vehicle and the user has no intention of getting in the vehicle, communication between the electronic key and the portable device is brought into a disconnected state.