An augmented reality device used in a medical imaging laboratory housing a medical imaging device (10) includes a headset (30), cameras (32, 33) mounted in the medical imaging laboratory, and directional sensors (34, 35, 36, 37) mounted on the headset. The cameras generate a panorama image (54). Data collected by the directional sensors is processed to determine the viewing direction (60). The panorama image and the determined viewing direction are processed to generate an augmented patient view image (80) in which the medical imaging device is removed, replaced, or made partially transparent, the augmented image is presented on a display (40) of the headset. The directional sensors may include a headset camera (34) that provides a patient view image (50), which is augmented by removing or making partially transparent any portion of the medical imaging device in the patient view image by substituting corresponding portions of the panorama image.