Invention Grant
- Patent Title: Apparatus and method for generating lip sync image
-
Application No.: US17764324Application Date: 2021-06-03
-
Publication No.: US12190903B2Publication Date: 2025-01-07
- Inventor: Guem Buel Hwang , Gyeong Su Chae
- Applicant: DEEPBRAIN AI INC.
- Applicant Address: KR Seoul
- Assignee: DEEPBRAIN AI INC.
- Current Assignee: DEEPBRAIN AI INC.
- Current Assignee Address: KR Seoul
- Agency: The PL Law Group, PLLC
- Priority: KR10-2020-0172024 20201210
- International Application: PCT/KR2021/006913 WO 20210603
- International Announcement: WO2022/124498 WO 20220616
- Main IPC: G10L21/10
- IPC: G10L21/10 ; G06T13/40 ; G06T13/80

Abstract:
An apparatus for generating a lip sync image according to a disclosed embodiment has one or more processors and a memory which stores one or more programs executed by the one or more processors. The apparatus includes a first artificial neural network model configured to generate an utterance synthesis image by using a person background image and an utterance audio signal corresponding to the person background image as an input, and generate a silence synthesis image by using only the person background image as an input, and a second artificial neural network model configured to output, from a preset utterance maintenance image and the first artificial neural network model, classification values for the preset utterance maintenance image and the silence synthesis image by using the silence synthesis image as an input.
Public/Granted literature
- US20230178095A1 APPARATUS AND METHOD FOR GENERATING LIP SYNC IMAGE Public/Granted day:2023-06-08
Information query