A vehicle control system includes: a vehicle control device that is mounted on a vehicle a portable device that is carried by a user and performs wireless communication with the vehicle control device; and a living body sensor that detects presence of a living body in a vehicle interior of the vehicle. The vehicle control device includes: an in-vehicle transmission unit that transmits a response request signal to the portable device; an in-vehicle reception unit that receives a response signal returned from the portable device in response to the response request signal; and a notification control unit that does not perform notification to the vehicle interior or an outside of the vehicle when the living body sensor detects that the living body is present in the vehicle interior and the in-vehicle reception unit receives the response signal.