System, method, and device for controlling a vehicle. In one example, the system includes an electronic processor configured to capture, via a camera, a first image, determine, within the first image, a road traffic factor, and generate, based on sensor information from one or more sensors of the vehicle, a second image depicting an environment surrounding the vehicle. The second image includes the road traffic factor. The electronic processor is also configured to, determine, based on the detected road traffic factor and the second image, a predicted trajectory of a traffic participant proximate to the vehicle, and generate a steering command for the vehicle based on the predicted trajectory.