A vision first light detection and ranging (LIDAR) system captures an image including a targeted object and uses the image to determine a predicted location of the targeted object. Based on the predicted location, the vision first LIDAR system directs a tracking beam onto the targeted object and detects a portion of the tracking beam reflected by the targeted object. The vision first LIDAR system includes an image sensor to capture the image for predicting the location of the targeted object and includes a distance sensor to determine a distance to the targeted object using the tracking beam.