An exterior rearview system for an autonomous vehicle includes a housing adapted for mounting to an exterior side of a vehicle, the housing holding at least one of a reflective element or display screen for displaying to a driver a rear or side image of the vehicle, one or more lighting modules disposed in the housing and providing an adaptive lighting sector which is adaptively controlled, and a control system configured to receive input data related to at least one of a user's intention using a tracking sensor and a user's retaking control of the autonomous vehicle.