公开(公告)号：US20190065492A1

公开(公告)日：2019-02-28

申请号：US16077449

申请日：2017-02-13

Applicant: SRI International

Inventor： Hui Cheng ,  Jingen Liu ,  Harpreet Sawhney ,  Mohamed Elhoseiny

IPC: G06F17/30 ,  G06F17/27 ,  G06K9/34 ,  G10L15/26

Abstract: Zero-shot content detection includes building/training a semantic space by embedding word-based document descriptions of a plurality of documents into a multi-dimensional space using a semantic embedding technique; detecting a plurality of features in the multimodal content by applying feature detection algorithms to the multimodal content; determining respective word-based concept descriptions for concepts identified in the multimodal content using the detected features; embedding the respective word-based concept descriptions into the semantic space; and in response to a content detection action, (i) embedding/mapping words representative of the content detection action into the semantic space, (ii) automatically determining, without the use of training examples, concepts in the semantic space relevant to the content detection action based on the embedded words, and (iii) identifying portions of the multimodal content responsive to the content detection action based on the concepts in the semantic space determined to be relevant to the content detection action.

公开(公告)号：US10198509B2

公开(公告)日：2019-02-05

申请号：US15005795

申请日：2016-01-25

Applicant: SRI INTERNATIONAL

Inventor： Hui Cheng ,  Harpreet Singh Sawhney ,  Ajay Divakaran ,  Qian Yu ,  Jingen Liu ,  Amir Tamrakar ,  Saad Ali ,  Omar Javed

IPC: G06F17/30

Abstract: A complex video event classification, search and retrieval system can generate a semantic representation of a video or of segments within the video, based on one or more complex events that are depicted in the video, without the need for manual tagging. The system can use the semantic representations to, among other things, provide enhanced video search and retrieval capabilities.

公开(公告)号：US20160004911A1

公开(公告)日：2016-01-07

申请号：US14846318

申请日：2015-09-04

Applicant: SRI International

Inventor： Hui Cheng ,  Ajay Divakaran ,  Elizabeth Shriberg ,  Harpreet Singh Sawhney ,  Jingen Liu ,  Ishani Chakraborty ,  Omar Javed ,  David Chisolm ,  Behjat Siddiquie ,  Steven S. Weiner

IPC: G06K9/00 ,  H04N21/44 ,  H04N21/8549 ,  H04N21/439 ,  H04N21/233 ,  H04N21/234

Abstract: A computing system for recognizing salient events depicted in a video utilizes learning algorithms to detect audio and visual features of the video. The computing system identifies one or more salient events depicted in the video based on the audio and visual features.

Abstract translation: 用于识别视频中描绘的突出事件的计算系统利用学习算法来检测视频的音频和视觉特征。 计算系统基于音频和视觉特征识别视频中描绘的一个或多个突出事件。