Invention Grant
- Patent Title: Visual dubbing using synthetic models
-
Application No.: US18068717Application Date: 2022-12-20
-
Publication No.: US12087091B2Publication Date: 2024-09-10
- Inventor: Hyeongwoo Kim
- Applicant: Flawless Holdings Limited
- Applicant Address: GB London
- Assignee: Flawless Holdings Limited
- Current Assignee: Flawless Holdings Limited
- Current Assignee Address: GB London
- Agency: EIP US LLP
- Main IPC: G06V40/10
- IPC: G06V40/10 ; G06N3/045 ; G06T17/00 ; G06V10/82 ; G06V40/16

Abstract:
A computer-implemented method of processing target footage of a target human face includes training an encoder-decoder network comprising an encoder network, a first decoder network, and a second decoder network. The training includes training a first path through the encoder-decoder network including the encoder network and the first decoder network to reconstruct the target footage of the target human face, and training a second path through the encoder-decoder network including the encoder network and the second decoder network to process renders of a synthetic face model exhibiting a range of poses and expressions to determine parameter values for the synthetic face model corresponding to the range of poses and expressions. The method includes processing, using a trained network path comprising or trained using the encoder network and comprising the first decoder network, source data representing the synthetic face model exhibiting a source sequence of expressions, to generate output video data.
Public/Granted literature
- US20230419723A1 VISUAL DUBBING USING SYNTHETIC MODELS Public/Granted day:2023-12-28
Information query