Systems and methods for controlling an autonomous vehicle are provided. In one example embodiment, a computer-implemented method includes providing a control of the autonomous vehicle to a user associated with a vehicle service. The method includes identifying one or more release signals indicative of one or more actions of the user. The method includes releasing the control of the autonomous vehicle from the user, based at least in part on the release signals.