- Patent Title: Systems for augmented reality surgical and clinical visualization
-
Application No.: US17049457Application Date: 2019-05-10
-
Publication No.: US11666411B2Publication Date: 2023-06-06
- Inventor: Michelle S. Bradbury , Krishna Juluru
- Applicant: Memorial Sloan Kettering Cancer Center
- Applicant Address: US NY New York
- Assignee: Memorial Sloan Kettering Cancer Center
- Current Assignee: Memorial Sloan Kettering Cancer Center
- Current Assignee Address: US NY New York
- Agency: Choate, Hall & Stewart LLP
- Agent William R. Haulbrook; Margo R. Monroe
- International Application: PCT/US2019/031828 2019.05.10
- International Announcement: WO2019/217893A 2019.11.14
- Date entered country: 2020-10-21
- Main IPC: A61B90/00
- IPC: A61B90/00 ; G06T19/00 ; A61B90/50 ; H04N5/33

Abstract:
Presented herein are systems, methods, and architectures related to augmented reality (AR) surgical visualization of one or more dual-modality probe species in tissue. As described herein, near infrared (NIR) images are detected and rendered in real time. The NIR images are registered and/or overlaid with one or more radiological images (e.g., which were obtained preoperatively/perioperatively) by a processor [e.g., that uses an artificial neural network (ANN) or convolutional neural network (CNN) reconstruction algorithm] to produce a real-time AR overlay (3D representation). The AR overlay is displayed to a surgeon in real time. Additionally, a dynamic motion tracker tracks the location of fiducial tracking sensors on/in/about the subject, and this information is also used by the processor in producing (e.g., positionally adjusting) the AR overlay. The real-time AR overlay can improve surgery outcomes, for example, by providing additional real-time information about a surgical site via an intuitive visual interface.
Public/Granted literature
- US20210045838A1 SYSTEMS FOR AUGMENTED REALITY SURGICAL AND CLINICAL VISUALIZATION Public/Granted day:2021-02-18
Information query