- Patent Title: System and method for voice driven lip syncing and head reenactment
-
Application No.: US17377109Application Date: 2021-07-15
-
Publication No.: US11461948B2Publication Date: 2022-10-04
- Inventor: Eliran Kuta , Sella Blondheim , Gil Perry , Amitay Nachmani , Matan Ben-Yosef , Or Gorodissky
- Applicant: DE-IDENTIFICATION LTD.
- Applicant Address: IL Tel Aviv
- Assignee: DE-IDENTIFICATION LTD.
- Current Assignee: DE-IDENTIFICATION LTD.
- Current Assignee Address: IL Tel Aviv
- Agency: Pearl Cohen Zedek Latzer Baratz LLP
- Main IPC: G06T13/20
- IPC: G06T13/20 ; G10L15/02 ; G06N20/00 ; G06T13/40 ; G06T13/80

Abstract:
A system and method voice driven animation of an object in an image by sampling an input video, depicting a puppet object, to obtain an image, receiving audio data, extracting voice related features from the audio data, producing an expression representation based on the voice related features, wherein the expression representation is related to a region of interest, obtaining from the image, auxiliary data related to the image and generating a target image based on the expression representation and the auxiliary data.
Public/Granted literature
- US20220020196A1 SYSTEM AND METHOD FOR VOICE DRIVEN LIP SYNCING AND HEAD REENACTMENT Public/Granted day:2022-01-20
Information query