An autonomous vehicle includes a detection system for identifying the presence of authorities or emergency vehicles on a road, such as law enforcement vehicles, fire engines, fire trucks, police officers, first responders, traffic cones, flares, etc. The detection system may include audio and visual detection system dedicated to the detection of authorities. Additionally, systems that correlate the detected authorities and/or any audible or visual instructions given by the authorities to changes in the behavior of the autonomous vehicle. The autonomous vehicle may react to the detected authorities or emergency vehicles by determining a driving related operation to safely operate around the detected authorities or emergency vehicles.