Systems, methods, and techniques for assessing driver safety based on noise levels or sounds associated with the interior of a vehicle are provided. Noise levels or sounds associated with the interior of a vehicle over a first interval of time may be compared to indications of vehicle motion over the first interval of time to identify noise levels or sounds at times when the indications of vehicle motion indicate unsafe driving. The identified noise levels or sounds may be analyzed to determine noise levels, sources, and/or characteristics of sounds associated with unsafe driving. Noise levels or sounds associated with the interior of the vehicle over a second interval of time may be analyzed to determine instances in which the noise levels, sources, and/or characteristics of sounds associated with unsafe driving occur over the second interval of time. Alerts may be generated for vehicle operators based on the determined instances.