公开(公告)号：US20210390792A1

公开(公告)日：2021-12-16

申请号：US17462113

申请日：2021-08-31

Applicant: Tsinghua University

Inventor： Feng XU ,  Zhibo WANG ,  Chengzeng FENG ,  Jingwang LING ,  Dong YANG

IPC: G06T19/20 ,  G06T13/40 ,  G06T7/55 ,  G06K9/00

Abstract: A method for customizing facial expressions of a user includes: obtaining a RGB-D image sequence, performing non-rigid registration on a three-dimensional (3D) face template model with a depth map and face feature points corresponding to the RGB-D image sequence, inputting each vertex in the non-rigid registration result into the depth map to generate a set of deformation data, and deforming the 3D face template model based on the set of deformation data; reconstructing face details in the RGB-D image sequence, and generating a 3D neutral face model based on the deformed 3D face template model and the reconstructed 3D face template model; processing the 3D neutral face model and a face hybrid template to generate a face hybrid model; tracking the face in the RGB-D image sequence to generate a face tracking result; and updating the face hybrid model based on the face tracking result and customizing the facial expressions.