Invention Grant
- Patent Title: Automated generation of self-guided augmented reality session plans from remotely-guided augmented reality sessions
-
Application No.: US17073354Application Date: 2020-10-18
-
Publication No.: US11361515B2Publication Date: 2022-06-14
- Inventor: Erez Lev Meir Bilgory , Adi Raz Goldfarb
- Applicant: International Business Machines Corporation
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agent Dvir Gassner
- Main IPC: G06T19/00
- IPC: G06T19/00 ; H04L51/046 ; G06T19/20 ; H04W4/029 ; G06F40/35

Abstract:
Generating a self-guided augmented reality (AR) session plan from a remotely-guided AR session held between a remote user and a local user, by: Receiving data recorded during the remotely-guided AR session. Segmenting the data into temporal segments that correspond to steps performed by the local user during the remotely-guided AR session. The steps are detected using at least one of: a Natural-Language Understanding (NLU) algorithm applied to a conversation included in the data, to detect utterances indicative of step-to-step transitions; location analysis of annotations included in the data, to detect location differences indicative of step-to-step transitions; and analysis of camera pose data included in the data, to detect pose transitions indicative of step-to-step transitions. Generating the self-guided AR session plan based on the segmented data and a 3D representation of the scene, the AR session plan including step-by-step AR guidance on how to perform the various steps.
Public/Granted literature
Information query