Invention Grant
US09542934B2 Systems and methods for using latent variable modeling for multi-modal video indexing
有权
用于多模态视频索引的潜变量建模的系统和方法
- Patent Title: Systems and methods for using latent variable modeling for multi-modal video indexing
- Patent Title (中): 用于多模态视频索引的潜变量建模的系统和方法
-
Application No.: US14192861Application Date: 2014-02-27
-
Publication No.: US09542934B2Publication Date: 2017-01-10
- Inventor: Matthew L. Cooper , Dhiraj Joshi , Huizhong Chen
- Applicant: FUJI XEROX CO., LTD.
- Applicant Address: JP Tokyo
- Assignee: FUJI XEROX CO., LTD.
- Current Assignee: FUJI XEROX CO., LTD.
- Current Assignee Address: JP Tokyo
- Agency: TransPacific Law Group
- Agent Pavel I. Pogodin, Esq.
- Main IPC: G10L15/05
- IPC: G10L15/05 ; G06F17/30 ; G11B27/00 ; G06K9/32 ; H04N21/2343 ; H04N21/4402 ; G06K9/00 ; H04N7/088 ; G06N7/00

Abstract:
A computer-implemented method performed in connection with a computerized system incorporating a processing unit and a memory, the computer-implemented method involving: using the processing unit to generate a multi-modal language model for co-occurrence of spoken words and displayed text in the plurality of videos; selecting at least a portion of a first video; extracting a plurality of spoken words from the selected portion of the first video; extracting a first displayed text from the selected portion of the first video; and using the processing unit and the generated multi-modal language model to rank the extracted plurality of spoken words based on probability of occurrence conditioned on the extracted first displayed text.
Public/Granted literature
- US20150243276A1 SYSTEMS AND METHODS FOR USING LATENT VARIABLE MODELING FOR MULTI-MODAL VIDEO INDEXING Public/Granted day:2015-08-27
Information query