Disclosed are various embodiments for implementing passenger profiles for autonomous vehicles. A passenger of the autonomous vehicle is identified. A passenger profile corresponding to the passenger and comprising a passenger preference is identified. The passenger preference is identified. A configuration setting of the autonomous vehicle corresponding to autonomous operation of the autonomous vehicle is then adjusted based at least in part on the passenger preference.