Invention Grant
- Patent Title: Video reenactment with hair shape and motion transfer
-
Application No.: US17559437Application Date: 2021-12-22
-
Publication No.: US11769346B2Publication Date: 2023-09-26
- Inventor: Mohamed N. Moustafa , Ahmed A. Ewais , Amr A. Ali
- Applicant: Spree3D Corporation
- Applicant Address: US NV Incline Village
- Assignee: Spree3d Corporation
- Current Assignee: Spree3d Corporation
- Current Assignee Address: US NV Incline Village
- Agency: RADLO & SU
- Agent Edward J. Radlo
- Main IPC: G06V40/16
- IPC: G06V40/16 ; G06V40/10 ; G06T7/246 ; G06V10/60 ; G06N3/045

Abstract:
Methods and apparati for inserting face and hair information from a source video (401) into a destination (driver) video (402) while mimicking pose, illumination, and hair motion of the destination video (402). An apparatus embodiment comprises an identity encoder (404) configured to encode face and hair information of the source video (401) and to produce as an output an identity vector; a pose encoder (405) configured to encode pose information of the destination video (402) and to produce as an output a pose vector; an illumination encoder (406) configured to encode head and hair illumination of the destination video (402) and to produce as an output an illumination vector; and a hair motion encoder (414) configured to encode hair motion of the destination video (402) and to produce as an output a hair motion vector. The identity vector, pose vector, illumination vector, and hair motion vector are fed as inputs to a neural network generator (410). The neural network generator (410) is configured to generate, in response to the four inputs, a composite video (403) comprising face and hair information from the source video (401) inserted into the destination video (402).
Public/Granted literature
- US20220392255A1 VIDEO REENACTMENT WITH HAIR SHAPE AND MOTION TRANSFER Public/Granted day:2022-12-08
Information query