A computing system can crop an image based on a width, height and location of a first vehicle in the image. The computing system can estimate a pose of the first vehicle based on inputting the cropped image and the width, height and location of the first vehicle into a deep neural network. The computing system can then operate a second vehicle based on the estimated pose. The computing system may train a model to identify a type and a location of a hazard according to the estimated pose, the hazard being such things as ice, mud, pothole, or other hazard. The model may be used by an autonomous vehicle to identify and avoid hazards or to provide drive assistance alerts.