公开(公告)号：US20160378861A1

公开(公告)日：2016-12-29

申请号：US14878448

申请日：2015-10-08

Applicant: SRI International

Inventor： Jayakrishnan Eledath ,  Supun Samarasekera ,  Harpreet S. Sawhney ,  Rakesh Kumar ,  Mayank Bansal ,  Girish Acharya ,  Michael John Wolverton ,  Aaron Spaulding ,  Ron Krakower

IPC: G06F17/30 ,  G06T19/00 ,  G06F3/01 ,  G06K9/00

CPC classification number: G06F3/011 ,  G06K9/00718 ,  G06K9/00771 ,  G06T19/006

Abstract: A computing system includes a vision-based user interface platform to, among other things, analyze multi-modal user interactions, semantically correlate stored knowledge with visual features of a scene depicted in a video, determine relationships between different features of the scene, and selectively display virtual elements on the video depiction of the scene. The analysis of user interactions can be used to filter the information retrieval and correlating of the visual features with the stored knowledge.

Abstract translation: 计算系统包括基于视觉的用户界面平台，用于分析多模式用户交互，将存储的知识与视频中描绘的场景的视觉特征语义相关，确定场景的不同特征之间的关系，以及选择性地 在场景的视频描绘中显示虚拟元素。 用户交互的分析可用于过滤信息检索和视觉特征与存储知识的关联。