公开(公告)号：US20160378861A1

公开(公告)日：2016-12-29

申请号：US14878448

申请日：2015-10-08

Applicant: SRI International

Inventor： Jayakrishnan Eledath ,  Supun Samarasekera ,  Harpreet S. Sawhney ,  Rakesh Kumar ,  Mayank Bansal ,  Girish Acharya ,  Michael John Wolverton ,  Aaron Spaulding ,  Ron Krakower

IPC: G06F17/30 ,  G06T19/00 ,  G06F3/01 ,  G06K9/00

CPC classification number: G06F3/011 ,  G06K9/00718 ,  G06K9/00771 ,  G06T19/006

Abstract: A computing system includes a vision-based user interface platform to, among other things, analyze multi-modal user interactions, semantically correlate stored knowledge with visual features of a scene depicted in a video, determine relationships between different features of the scene, and selectively display virtual elements on the video depiction of the scene. The analysis of user interactions can be used to filter the information retrieval and correlating of the visual features with the stored knowledge.

Abstract translation: 计算系统包括基于视觉的用户界面平台，用于分析多模式用户交互，将存储的知识与视频中描绘的场景的视觉特征语义相关，确定场景的不同特征之间的关系，以及选择性地 在场景的视频描绘中显示虚拟元素。 用户交互的分析可用于过滤信息检索和视觉特征与存储知识的关联。

公开(公告)号：US10573037B2

公开(公告)日：2020-02-25

申请号：US13721276

申请日：2012-12-20

Applicant: SRI International

Inventor： Rakesh Kumar ,  Supun Samarasekera ,  Girish Acharya ,  Michael John Wolverton ,  Necip Fazil Ayan ,  Zhiwei Zhu ,  Ryan Villamil

IPC: G09G5/00 ,  G06T11/60 ,  G06F3/01

Abstract: A method and apparatus for training and guiding users comprising generating a scene understanding based on video and audio input of a scene of a user performing a task in the scene, correlating the scene understanding with a knowledge base to produce a task understanding, comprising one or more goals, of a current activity of the user, reasoning, based on the task understanding and a user's current state, a next step for advancing the user towards completing one of the one or more goals of the task understanding and overlaying the scene with an augmented reality view comprising one or more visual and audio representation of the next step to the user.

公开(公告)号：US10824310B2

公开(公告)日：2020-11-03

申请号：US14313578

申请日：2014-06-24

Applicant: SRI International

Inventor： Girish Acharya ,  Rakesh Kumar ,  Supun Samarasekara ,  Louise Yarnall ,  Michael John Wolverton ,  Zhiwei Zhu ,  Ryan Villamil ,  Vlad Branzoi ,  James F. Carpenter ,  Glenn A. Murray

IPC: G06F3/0484 ,  G06T19/00 ,  G06F3/16 ,  G06T11/00 ,  G06F9/451

Abstract: A computing system for virtual personal assistance includes technologies to, among other things, correlate an external representation of an object with a real world view of the object, display virtual elements on the external representation of the object and/or display virtual elements on the real world view of the object, to provide virtual personal assistance in a multi-step activity or another activity that involves the observation or handling of an object and a reference document.

公开(公告)号：US20140310595A1

公开(公告)日：2014-10-16

申请号：US14313578

申请日：2014-06-24

Applicant: SRI International

Inventor： Girish Acharya ,  Rakesh Kumar ,  Supun Samarasekara ,  Louise Yarnall ,  Michael John Wolverton ,  Zhiwei Zhu ,  Ryan Villamil ,  Vlad Braznoi ,  James F. Carpenter ,  Glenn A. Murray

IPC: G06F9/44 ,  G06F3/0484 ,  G06T19/00

Abstract: A computing system for virtual personal assistance includes technologies to, among other things, correlate an external representation of an object with a real world view of the object, display virtual elements on the external representation of the object and/or display virtual elements on the real world view of the object, to provide virtual personal assistance in a multi-step activity or another activity that involves the observation or handling of an object and a reference document.

Abstract translation: 用于虚拟个人帮助的计算系统包括用于将对象的外部表示与对象的真实世界视图相关联的技术，在对象的外部表示上显示虚拟元素和/或在实际上显示虚拟元素 对象的世界观，在多步骤活动或涉及观察或处理对象和参考文档的其他活动中提供虚拟个人帮助。