公开(公告)号：US11055514B1

公开(公告)日：2021-07-06

申请号：US16220859

申请日：2018-12-14

Applicant: Snap Inc.

Inventor： Chen Cao ,  Sergey Tulyakov ,  Zhenglin Geng

IPC: G06K9/00

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for synthesizing a realistic image with a new expression of a face in an input image by receiving an input image comprising a face having a first expression; obtaining a target expression for the face; and extracting a texture of the face and a shape of the face. The program and method for generating, based on the extracted texture of the face, a target texture corresponding to the obtained target expression using a first machine learning technique; generating, based on the extracted shape of the face, a target shape corresponding to the obtained target expression using a second machine learning technique; and combining the generated target texture and generated target shape into an output image comprising the face having a second expression corresponding to the obtained target expression.

公开(公告)号：US20210165998A1

公开(公告)日：2021-06-03

申请号：US17248908

申请日：2021-02-12

Applicant: Snap Inc.

Inventor： Chen Cao ,  Menglei Chai ,  Linjie Luo ,  Oliver Woodford

IPC: G06K9/00 ,  G06T13/40 ,  G06T7/73

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex that is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.

公开(公告)号：US10719968B2

公开(公告)日：2020-07-21

申请号：US16387092

申请日：2019-04-17

Applicant: Snap Inc.

Inventor： Chen Cao ,  Yang Gao ,  Zehao Xue

IPC: G06T13/20 ,  G06K9/00 ,  G06T19/20 ,  G06T7/73 ,  G06T19/00

Abstract: Embodiments described herein relate to an augmented expression system to generate and cause display of a specially configured interface to present an augmented reality perspective. The augmented expression system receives image and video data of a user and tracks facial landmarks of the user based on the image and video data, in real-time to generate and present a 3-dimensional (3D) bitmoji of the user.

公开(公告)号：US20190130628A1

公开(公告)日：2019-05-02

申请号：US15858992

申请日：2017-12-29

Applicant: Snap Inc.

Inventor： Chen Cao ,  Xin Chen ,  Wei Chu ,  Zehao Xue

IPC: G06T13/20 ,  G06T13/40 ,  G06K9/00 ,  H04L12/58

Abstract: The present invention relates to a joint automatic audio visual driven facial animation system that in some example embodiments includes a full scale state of the art Large Vocabulary Continuous Speech Recognition (LVCSR) with a strong language model for speech recognition and obtained phoneme alignment from the word lattice.