Invention Grant
- Patent Title: Audio and video translator
-
Application No.: US17737546Application Date: 2022-05-05
-
Publication No.: US11551664B2Publication Date: 2023-01-10
- Inventor: Rijul Gupta , Emma Brown
- Applicant: Deep Media Inc.
- Applicant Address: US CA Oakland
- Assignee: Deep Media Inc.
- Current Assignee: Deep Media Inc.
- Current Assignee Address: US CA Oakland
- Agency: Smith & Hopen, P. A.
- Agent Nicholas Pfeifer
- Main IPC: G06F30/27
- IPC: G06F30/27 ; G10L13/08 ; G10L15/04 ; G10L17/00 ; G06F40/103 ; G06T7/20 ; G06F40/42

Abstract:
A system and method for translating audio, and video when desired. The translations include synthetic media and data generated using AI systems. Through unique processors and generators executing a unique sequence of steps, the system and method produces more accurate translations that can account for various speech characteristics (e.g., emotion, pacing, idioms, sarcasm, jokes, tone, phonemes, etc.). These speech characteristics are identified in the input media and synthetically incorporated into the translated outputs to mirror the characteristics in the input media. Some embodiments further include systems and methods that manipulate the input video such that the speakers' faces and/or lips appear as if they are natively speaking the generated audio.
Public/Granted literature
- US20220358905A1 AUDIO AND VIDEO TRANSLATOR Public/Granted day:2022-11-10
Information query