Systems and methods for assessing vehicle operation are provided. According to certain aspects, an electronic device may receive and analyze image data depicting an individual located within a vehicle. The electronic device may also access and compile vehicle operation data and operator data corresponding to a state or condition of the vehicle operator. The electronic device may identify, from the vehicle operator data, a set of close misses experienced by the vehicle, correlate the set of close misses with a state or condition of the vehicle operator, and attribute at least some of the close misses to the vehicle operator. A remote server may aggregate and compile corresponding data from a plurality of vehicles.