The current disclosure provides techniques for using human driving behavior to assist in decision making of an autonomous vehicle as the autonomous vehicle encounters various scenarios on the road. For each scenario, a model may be generated based on human driving behavior that governs how an autonomous vehicle maneuvers in that scenario. As a result of using these models, reliability and safety of autonomous vehicle may be improved. In addition, because the model is programmed into the autonomous vehicle, the autonomous vehicle, in many instances, need not consume resources to implement complex calculations to determine driving behavior in real-time.