-
公开(公告)号：US20230306675A1
公开(公告)日：2023-09-28
申请号：US17656778
申请日：2022-03-28
Applicant: Snap Inc.
Inventor： Zeng Huang , Jian Ren , Sergey Tulyakov , Menglei Chai , Kyle Olszewski , Huan Wang
CPC classification number: G06T15/06 , G06T7/97 , G06T2207/20081 , G06T2207/20084
Abstract: Methods and systems are disclosed for performing operations for generating a 3D model of a scene. The operations include: receiving a set of two-dimensional (2D) images representing a first view of a real-world environment; applying a machine learning model comprising a neural light field network to the set of 2D images to predict pixel values of a target image representing a second view of the real-world environment, the machine learning model being trained to map a ray origin and direction directly to a given pixel value; and generating a three-dimensional (3D) model of the real-world environment based on the set of 2D images and the predicted target image.
-
公开(公告)号：US20230252639A1
公开(公告)日：2023-08-10
申请号：US18136212
申请日：2023-04-18
Applicant: Snap Inc.
Inventor： Menglei Chai , David LeMieux , Shubham Vij , Ian Wehrman
CPC classification number: G06T7/11 , G06F3/04845 , G06T7/12 , G06T7/13 , G06T7/174 , G06T7/194 , G06V10/56 , G06T2207/20104 , G06T2207/20132
Abstract: An image segmentation system to perform operations that include causing display of an image within a graphical user interface of a client device, receive a set of user inputs that identify portions of a background and foreground of the image, identify a boundary of an object depicted within the image based on the set of user inputs, crop the object from the image based on the boundary, and generate a media item based on the cropped object, wherein properties of the media object, such as a size and a shape, are based on the boundary of the object.
-
公开(公告)号：US11663723B2
公开(公告)日：2023-05-30
申请号：US17249445
申请日：2021-03-02
Applicant: Snap Inc.
Inventor： Shubham Vij , Menglei Chai , David LeMieux , Ian Wehrman
CPC classification number: G06T7/11 , G06F3/04845 , G06T7/12 , G06T7/13 , G06T7/174 , G06T7/194 , G06V10/56 , G06T2207/20104 , G06T2207/20132
Abstract: An image segmentation system to perform operations that include causing display of an image within a graphical user interface of a client device, receive a set of user inputs that identify portions of a background and foreground of the image, identify a boundary of an object depicted within the image based on the set of user inputs, crop the object from the image based on the boundary, and generate a media item based on the cropped object, wherein properties of the media object, such as a size and a shape, are based on the boundary of the object.
-
公开(公告)号：US20230079136A1
公开(公告)日：2023-03-16
申请号：US17987285
申请日：2022-11-15
Applicant: Snap Inc.
Inventor： Artem Bondich , Menglei Chai , Oleksandr Pyshchenko , Jian Ren , Sergey Tulyakov
Abstract: A messaging system performs neural network hair rendering for images provided by users of the messaging system. A method of neural network hair rendering includes processing a three-dimensional (3D) model of fake hair and a first real hair image depicting a first person to generate a fake hair structure, and encoding, using a fake hair encoder neural subnetwork, the fake hair structure to generate a coded fake hair structure. The method further includes processing, using a cross-domain structure embedding neural subnetwork, the coded fake hair structure to generate a fake and real hair structure, and encoding, using an appearance encoder neural subnetwork, a second real hair image depicting a second person having a second head to generate an appearance map. The method further includes processing, using a real appearance renderer neural subnetwork, the appearance map and the fake and real hair structure to generate a synthesized real image.
-
公开(公告)号：US11521362B2
公开(公告)日：2022-12-06
申请号：US17445549
申请日：2021-08-20
Applicant: Snap Inc.
Inventor： Artem Bondich , Menglei Chai , Oleksandr Pyshchenko , Jian Ren , Sergey Tulyakov
Abstract: A messaging system performs neural network hair rendering for images provided by users of the messaging system. A method of neural network hair rendering includes processing a three-dimensional (3D) model of fake hair and a first real hair image depicting a first person to generate a fake hair structure, and encoding, using a fake hair encoder neural subnetwork, the fake hair structure to generate a coded fake hair structure. The method further includes processing, using a cross-domain structure embedding neural subnetwork, the coded fake hair structure to generate a fake and real hair structure, and encoding, using an appearance encoder neural subnetwork, a second real hair image depicting a second person having a second head to generate an appearance map. The method further includes processing, using a real appearance renderer neural subnetwork, the appearance map and the fake and real hair structure to generate a synthesized real image.
-
Patent Agency Ranking
公开(公告)号：US20220207786A1
公开(公告)日：2022-06-30
申请号：US17557834
申请日：2021-12-21
Applicant: Snap Inc.
Inventor： Jian Ren , Menglei Chai , Oliver Woodford , Kyle Olszewski , Sergey Tulyakov
Abstract: Systems and methods herein describe a motion retargeting system. The motion retargeting system accesses a plurality of two-dimensional images comprising a person performing a plurality of body poses, extracts a plurality of implicit volumetric representations from the plurality of body poses, generates a three-dimensional warping field, the three-dimensional warping field configured to warp the plurality of implicit volumetric representations from a canonical pose to a target pose, and based on the three-dimensional warping field, generates a two-dimensional image of an artificial person performing the target pose.
-
公开(公告)号：US12299905B2
公开(公告)日：2025-05-13
申请号：US18235563
申请日：2023-08-18
Applicant: Snap Inc.
Inventor： Chen Cao , Menglei Chai , Linjie Luo , Oliver Woodford
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program and a method for accessing a set of images depicting at least a portion of a face. A set of facial regions of the face is identified, each facial region of the set of facial regions intersecting another facial region with at least one common vertex that is a member of a set of facial vertices. For each facial region of the set of facial regions, a weight formed from a set of region coefficients is generated. Based on the set of facial regions and the weight of each facial region of the set of facial regions, the face is tracked across the set of images.
-
公开(公告)号：US12299810B2
公开(公告)日：2025-05-13
申请号：US17846918
申请日：2022-06-22
Applicant: Snap Inc.
Inventor： Menglei Chai , Sergey Demyanov , Yunqing Hu , Istvan Marton , Daniil Ostashev , Aleksei Podkin
IPC: G06T15/50 , G06T15/80 , G06V10/774 , G06V10/82
Abstract: A method for applying lighting conditions to a virtual object in an augmented reality (AR) device is described. In one aspect, the method includes generating, using a camera of a mobile device, an image, accessing a virtual object corresponding to an object in the image, identifying lighting parameters of the virtual object based on a machine learning model that is pre-trained with a paired dataset, the paired dataset includes synthetic source data and synthetic target data, the synthetic source data includes environment maps and 3D scans of items depicted in the environment map, the synthetic target data includes a synthetic sphere image rendered in the same environment map, applying the lighting parameters to the virtual object, and displaying, in a display of the mobile device, the shaded virtual object as a layer to the image.
-
公开(公告)号：US12272015B2
公开(公告)日：2025-04-08
申请号：US18653609
申请日：2024-05-02
Applicant: Snap Inc.
Inventor： Artem Bondich , Menglei Chai , Oleksandr Pyshchenko , Jian Ren , Sergey Tulyakov
Abstract: A messaging system performs neural network hair rendering for images provided by users of the messaging system. A method of neural network hair rendering includes processing a three-dimensional (3D) model of fake hair and a first real hair image depicting a first person to generate a fake hair structure, and encoding, using a fake hair encoder neural subnetwork, the fake hair structure to generate a coded fake hair structure. The method further includes processing, using a cross-domain structure embedding neural subnetwork, the coded fake hair structure to generate a fake and real hair structure, and encoding, using an appearance encoder neural subnetwork, a second real hair image depicting a second person having a second head to generate an appearance map. The method further includes processing, using a real appearance renderer neural subnetwork, the appearance map and the fake and real hair structure to generate a synthesized real image.
-
公开(公告)号：US12141922B2
公开(公告)日：2024-11-12
申请号：US18216327
申请日：2023-06-29
Applicant: Snap Inc.
Inventor： Chen Cao , Menglei Chai , Linjie Luo , Soumyadip Sengupta
Abstract: A shape generation system can generate a three-dimensional (3D) model of an object from a two-dimensional (2D) image of the object by projecting vectors onto light cones created from the 2D image. The projected vectors can be used to more accurately create the 3D model of the object based on image element (e.g., pixel) values of the image.
-
-
-
-
-
-
-
-
-
Search Results
44
records
(took 0.028 seconds)
