Systems and methods for providing autonomous vehicle assistance are disclosed. In one embodiment, a method is disclosed comprising recording an image of a scene surrounding an autonomous vehicle; classifying the image using a machine learning system, the classifying comprising identifying whether the image includes a danger; determining whether the autonomous vehicle is able to respond to the danger in response to identifying that the image includes the danger; and executing one or more security maneuvers, the security maneuvers manipulating the operation of the autonomous vehicle in response to the danger.