Traffic direction gesture recognition may be implemented for a vehicle in response to traffic diversion signals in the vehicles vicinity. Sensors implemented as part of a vehicle may collect data about pedestrians and other obstacles in the vicinity of the vehicle or along the vehicle's route of travel. Sensor data may be combined and analyzed to identify a traffic diversion condition, including identifying a traffic director directing traffic using gestures or signs. Gestures of a traffic director may be interpreted and understood by the vehicle as commands to perform maneuvers related to the traffic diversion, including stopping, slowing, or turning onto a detour route. The vehicle may be equipped with a command acknowledgement device for acknowledging to a traffic director the vehicle's understanding of the traffic diversion condition or maneuver commands. Information, such as traffic diversion and detour information, may be shared with other vehicles and devices, or stored in a database.