A system and method is provided of providing recommendations to a user of a vehicle. In one aspect, the vehicle navigates autonomously and the sensors provide information that is based on the location of the vehicle and output from sensors directed to the environment surrounding the vehicle. In further aspects, both current and previous sensor data is used to make the recommendation, as well as data based on the sensors of other vehicles.