A device may determine a view of a user of a head mounted display. The device may obtain tracking data relating to a surgical procedure. The device may obtain, from an imaging device, surgical imaging relating to the surgical procedure. The device may orient models of objects based on the tracking data and the view of the user of the head mounted display, wherein the objects includes the imaging device. The device may augment, by providing output to the head mounted display for display, the view of the user with contextual information relating to the objects based on orienting the models based on the tracking data and the view of the user, wherein the contextual information includes the surgical imaging captured by an imaging device.