Invention Grant
- Patent Title: Method, system and apparatus for multilingual and multimodal keyword search in a mixlingual speech corpus
-
Application No.: US16646315Application Date: 2018-09-10
-
Publication No.: US11721329B2Publication Date: 2023-08-08
- Inventor: Arun Kumar , Abhimanyu Popli
- Applicant: Indian Institute of Technology, Delhi , Centre for Development of Telematics
- Applicant Address: IN New Delhi
- Assignee: Indian Institute of Technology, Delhi,Centre for Development of Telematics
- Current Assignee: Indian Institute of Technology, Delhi,Centre for Development of Telematics
- Current Assignee Address: IN New Delhi; IN New Delhi
- Agency: Volpe Koenig
- Priority: IN 1711032030 2017.09.11
- International Application: PCT/IB2018/056871 2018.09.10
- International Announcement: WO2019/049089A 2019.03.14
- Date entered country: 2020-03-11
- Main IPC: G10L15/187
- IPC: G10L15/187 ; G06F16/33 ; G06F16/35 ; G10L15/02 ; G10L15/22 ; G10L15/183 ; G06F16/60 ; G06F16/2452 ; G06F16/635 ; G10L15/08

Abstract:
In the present invention, a method for searching multilingual keywords in mixlingual speech corpus is proposed. This method is capable of searching audio as well as text keywords. The capability of audio search enables it to search out-of-vocabulary (OOV) words. The capability of searching text keywords enables it to perform semantic search. An advanced application of searching keyword translations in mixlingual speech corpus is also possible within posteriorgram framework with this system. Also, a technique for combining information from text and audio keywords is given which further enhances the search performance. This system is based on multiple posteriorgrams based on articulatory classes trained with multiple languages.
Public/Granted literature
Information query