-
公开(公告)号：US20240273809A1
公开(公告)日：2024-08-15
申请号：US18644653
申请日：2024-04-24
Applicant: Snap Inc.
Inventor： Zeng Huang , Jian Ren , Sergey Tulyakov , Menglei Chai , Kyle Olszewski , Huan Wang
CPC classification number: G06T15/06 , G06T7/97 , G06T2207/20081 , G06T2207/20084
Abstract: Methods and systems are disclosed for performing operations for generating a 3D model of a scene. The operations include: receiving a set of two-dimensional (2D) images representing a first view of a real-world environment; applying a machine learning model comprising a neural light field network to the set of 2D images to predict pixel values of a target image representing a second view of the real-world environment, the machine learning model being trained to map a ray origin and direction directly to a given pixel value; and generating a three-dimensional (3D) model of the real-world environment based on the set of 2D images and the predicted target image.
-
公开(公告)号：US12002146B2
公开(公告)日：2024-06-04
申请号：US17656778
申请日：2022-03-28
Applicant: Snap Inc.
Inventor： Zeng Huang , Jian Ren , Sergey Tulyakov , Menglei Chai , Kyle Olszewski , Huan Wang
CPC classification number: G06T15/06 , G06T7/97 , G06T2207/20081 , G06T2207/20084
Abstract: Methods and systems are disclosed for performing operations for generating a 3D model of a scene. The operations include: receiving a set of two-dimensional (2D) images representing a first view of a real-world environment; applying a machine learning model comprising a neural light field network to the set of 2D images to predict pixel values of a target image representing a second view of the real-world environment, the machine learning model being trained to map a ray origin and direction directly to a given pixel value; and generating a three-dimensional (3D) model of the real-world environment based on the set of 2D images and the predicted target image.
-
公开(公告)号：US20230419599A1
公开(公告)日：2023-12-28
申请号：US17846918
申请日：2022-06-22
Applicant: Snap Inc.
Inventor： Menglei Chai , Sergey Demyanov , Yunqing Hu , Istvan Marton , Daniil Ostashev , Aleksei Podkin
IPC: G06T15/50 , G06T15/80 , G06V10/82 , G06V10/774
CPC classification number: G06T15/506 , G06T15/80 , G06V10/82 , G06V10/774 , G06T2200/08 , G06T2200/04
Abstract: A method for applying lighting conditions to a virtual object in an augmented reality (AR) device is described. In one aspect, the method includes generating, using a camera of a mobile device, an image, accessing a virtual object corresponding to an object in the image, identifying lighting parameters of the virtual object based on a machine learning model that is pre-trained with a paired dataset, the paired dataset includes synthetic source data and synthetic target data, the synthetic source data includes environment maps and 3D scans of items depicted in the environment map, the synthetic target data includes a synthetic sphere image rendered in the same environment map, applying the lighting parameters to the virtual object, and displaying, in a display of the mobile device, the shaded virtual object as a layer to the image.
-
公开(公告)号：US20230386158A1
公开(公告)日：2023-11-30
申请号：US17814391
申请日：2022-07-22
Applicant: Snap Inc.
Inventor： Menglei Chai , Sergey Tulyakov , Jian Ren , Hsin-Ying Lee , Kyle Olszewski , Zeng Huang , Zezhou Cheng
CPC classification number: G06T19/20 , G06T17/00 , G06T2219/2012 , G06T2219/2021
Abstract: Systems, computer readable media, and methods herein describe an editing system where a three-dimensional (3D) object can be edited by editing a 2D sketch or 2D RGB views of the 3D object. The editing system uses multi-modal (MM) variational auto-decoders (VADs)(MM-VADs) that are trained with a shared latent space that enables editing 3D objects by editing 2D sketches of the 3D objects. The system determines a latent code that corresponds to an edited or sketched 2D sketch. The latent code is then used to generate a 3D object using the MM-VADs with the latent code as input. The latent space is divided into a latent space for shapes and a latent space for colors. The MM-VADs are trained with variational auto-encoders (VAE) and a ground truth.
-
公开(公告)号：US11074675B2
公开(公告)日：2021-07-27
申请号：US16051083
申请日：2018-07-31
Applicant: Snap Inc.
Inventor： Chen Cao , Wen Zhang , Menglei Chai , Linjie Luo
Abstract: Systems, devices, media, and methods are presented for generating texture models for objects within a video stream. The systems and methods access a set of images as the set of images are being captured at a computing device. The systems and methods determine, within a portion of the set of images, an area of interest containing an eye and extract an iris area from the area of interest. The systems and methods segment a sclera area within the area of interest and generate a texture for the eye based on the iris area and the sclera area.
-
Patent Agency Ranking
公开(公告)号：US10964023B1
公开(公告)日：2021-03-30
申请号：US16365228
申请日：2019-03-26
Applicant: Snap Inc.
Inventor： Shubham Vij , Menglei Chai , David LeMieux , Ian Wehrman
Abstract: An image segmentation system to perform operations that include causing display of an image within a graphical user interface of a client device, receive a set of user inputs that identify portions of a background and foreground of the image, identify a boundary of an object depicted within the image based on the set of user inputs, crop the object from the image based on the boundary, and generate a media item based on the cropped object, wherein properties of the media object, such as a size and a shape, are based on the boundary of the object.
-
公开(公告)号：US20250131571A1
公开(公告)日：2025-04-24
申请号：US18988018
申请日：2024-12-19
Applicant: Snap Inc.
Inventor： Menglei Chai , David LeMieux , Shubham Vij , lan Wehrman
Abstract: An image segmentation system to perform operations that include causing display of an image within a graphical user interface of a client device, receive a set of user inputs that identify portions of a background and foreground of the image, identify a boundary of an object depicted within the image based on the set of user inputs, crop the object from the image based on the boundary, and generate a media item based on the cropped object, wherein properties of the media object, such as a size and a shape, are based on the boundary of the object.
-
公开(公告)号：US12223657B2
公开(公告)日：2025-02-11
申请号：US18136212
申请日：2023-04-18
Applicant: Snap Inc.
Inventor： Menglei Chai , David LeMieux , Shubham Vij , Ian Wehrman
Abstract: An image segmentation system to perform operations that include causing display of an image within a graphical user interface of a client device, receive a set of user inputs that identify portions of a background and foreground of the image, identify a boundary of an object depicted within the image based on the set of user inputs, crop the object from the image based on the boundary, and generate a media item based on the cropped object, wherein properties of the media object, such as a size and a shape, are based on the boundary of the object.
-
公开(公告)号：US12154303B2
公开(公告)日：2024-11-26
申请号：US18238979
申请日：2023-08-28
Applicant: Snap Inc.
Inventor： Jian Ren , Menglei Chai , Sergey Tulyakov , Qing Jin
Abstract: System and methods for compressing image-to-image models. Generative Adversarial Networks (GANs) have achieved success in generating high-fidelity images. An image compression system and method adds a novel variant to class-dependent parameters (CLADE), referred to as CLADE-Avg, which recovers the image quality without introducing extra computational cost. An extra layer of average smoothing is performed between the parameter and normalization layers. Compared to CLADE, this image compression system and method smooths abrupt boundaries, and introduces more possible values for the scaling and shift. In addition, the kernel size for the average smoothing can be selected as a hyperparameter, such as a 3×3 kernel size. This method does not introduce extra multiplications but only addition, and thus does not introduce much computational overhead, as the division can be absorbed into the parameters after training.
-
公开(公告)号：US11710275B2
公开(公告)日：2023-07-25
申请号：US17499659
申请日：2021-10-12
Applicant: Snap Inc.
Inventor： Soumyadip Sengupta , Linjie Luo , Chen Cao , Menglei Chai
CPC classification number: G06T17/30 , G06V20/647 , G06V40/165 , G06V40/171
Abstract: A shape generation system can generate a three-dimensional (3D) model of an object from a two-dimensional (2D) image of the object by projecting vectors onto light cones created from the 2D image. The projected vectors can be used to more accurately create the 3D model of the object based on image element (e.g., pixel) values of the image.
-
-
-
-
-
-
-
-
-
Search Results
44
records
(took 0.024 seconds)
