Autonomous driving includes identifying a traffic behavior of an object in an environment surrounding a vehicle based on an evaluation of information about the environment surrounding the vehicle while the vehicle is in the midst of manual operation, and operating vehicle systems in the vehicle to perform a driving maneuver according to a driving plan for performing the driving maneuver. The autonomous driving further includes receiving a traffic behavior model that describes a predominating traffic behavior of a like population of reference objects, and operating the vehicle systems to perform the driving maneuver according to the driving plan in response to identifying that the traffic behavior of the object does not match the predominating traffic behavior of the like population of reference objects. Under the driving plan, the traffic behavior of the object is addressed.