公开(公告)号：US20220058880A1

公开(公告)日：2022-02-24

申请号：US17445549

申请日：2021-08-20

Applicant: Snap Inc.

Inventor： Artem Bondich ,  Menglei Chai ,  Oleksandr Pyshchenko ,  Jian Ren ,  Sergey Tulyakov

IPC: G06T19/00 ,  G06T19/20 ,  G06T17/00 ,  G06K9/62 ,  G06T7/246 ,  G06N3/04 ,  G06N3/08

Abstract: A messaging system performs neural network hair rendering for images provided by users of the messaging system. A method of neural network hair rendering includes processing a three-dimensional (3D) model of fake hair and a first real hair image depicting a first person to generate a fake hair structure, and encoding, using a fake hair encoder neural subnetwork, the fake hair structure to generate a coded fake hair structure. The method further includes processing, using a cross-domain structure embedding neural subnetwork, the coded fake hair structure to generate a fake and real hair structure, and encoding, using an appearance encoder neural subnetwork, a second real hair image depicting a second person having a second head to generate an appearance map. The method further includes processing, using a real appearance renderer neural subnetwork, the appearance map and the fake and real hair structure to generate a synthesized real image.

公开(公告)号：US11164376B1

公开(公告)日：2021-11-02

申请号：US16116590

申请日：2018-08-29

Applicant: Snap Inc.

Inventor： Soumyadip Sengupta ,  Linjie Luo ,  Chen Cao ,  Menglei Chai

IPC: G06K9/00 ,  G06T17/30

Abstract: A shape generation system can generate a three-dimensional (3D) model of an object from a two-dimensional (2D) image of the object by projecting vectors onto light cones created from the 2D image. The projected vectors can be used to more accurately create the 3D model of the object based on image element (e.g., pixel) values of the image.

公开(公告)号：US20210192744A1

公开(公告)日：2021-06-24

申请号：US17249445

申请日：2021-03-02

Applicant: Snap Inc.

Inventor： Shubham Vij ,  Menglei Chai ,  David LeMieux ,  Ian Wehrman

IPC: G06T7/11 ,  G06T7/194 ,  G06T7/13 ,  G06T7/12 ,  G06F3/0484 ,  G06T7/174

Abstract: An image segmentation system to perform operations that include causing display of an image within a graphical user interface of a client device, receive a set of user inputs that identify portions of a background and foreground of the image, identify a boundary of an object depicted within the image based on the set of user inputs, crop the object from the image based on the boundary, and generate a media item based on the cropped object, wherein properties of the media object, such as a size and a shape, are based on the boundary of the object.

公开(公告)号：US20210165998A1

公开(公告)日：2021-06-03

申请号：US17248908

申请日：2021-02-12

Applicant: Snap Inc.

Inventor： Chen Cao ,  Menglei Chai ,  Linjie Luo ,  Oliver Woodford

IPC: G06K9/00 ,  G06T13/40 ,  G06T7/73

Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex that is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.