-
公开(公告)号:US20220101536A1
公开(公告)日:2022-03-31
申请号:US17319381
申请日:2021-05-13
Applicant: Snap Inc.
Inventor: Igor Kudriashov , Fedir Poliakov , Maksim Gusarov
IPC: G06T7/20 , G06K9/00 , G06K9/46 , G06T11/00 , G06T3/40 , G06T5/00 , G06T7/11 , G06T7/136 , G06T7/73 , G06T7/90
Abstract: Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.
-
公开(公告)号:US11048916B2
公开(公告)日:2021-06-29
申请号:US16409390
申请日:2019-05-10
Applicant: Snap Inc.
Inventor: Maksim Gusarov , Igor Kudriashov , Valerii Filev , Sergei Kotcur
Abstract: Systems, devices, media, and methods are presented for generating facial representations using image segmentation with a client device. The systems and methods receive an image depicting a face, detect at least a portion of the face within the image, and identify a set of facial landmarks within the portion of the face. The systems and methods determine one or more characteristics representing the portion of the face, in response to detecting the portion of the face. Based on the one or more characteristics and the set of facial landmarks, the systems and methods generate a representation of a face.
-
公开(公告)号:US20210182624A1
公开(公告)日:2021-06-17
申请号:US17189563
申请日:2021-03-02
Applicant: Snap Inc.
Inventor: Sergey Tulyakov , Sergei Korolev , Aleksei Stoliar , Maksim Gusarov , Sergei Kotcur , Christopher Yale Crutchfield , Andrew Wan
Abstract: A compact generative neural network can be distilled from a teacher generative neural network using a training network. The compact network can be trained on the input data and output data of the teacher network. The training network train the student network using a discrimination layer and one or more types of losses, such as perception loss and adversarial loss.
-
公开(公告)号:US11030753B2
公开(公告)日:2021-06-08
申请号:US16698463
申请日:2019-11-27
Applicant: Snap Inc.
Inventor: Igor Kudriashov , Fedir Poliakov , Maksim Gusarov
IPC: G06K9/00 , G06T7/20 , G06K9/46 , G06T11/00 , G06T3/40 , G06T5/00 , G06T7/11 , G06T7/136 , G06T7/73 , G06T7/90
Abstract: Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.
-
公开(公告)号:US10198819B2
公开(公告)日:2019-02-05
申请号:US14953726
申请日:2015-11-30
Applicant: Snap Inc.
Inventor: Igor Kudriashov , Fedir Poliakov , Maksim Gusarov
IPC: G06K9/00 , G06T7/00 , G06K9/46 , G06T7/40 , G06T11/00 , G06T3/40 , G06T7/20 , G06T5/00 , G06T7/11 , G06T7/136
Abstract: Systems, devices, media, and methods are presented for segmenting an image of a video stream with a client device, identifying an area of interest, generating a modified area of interest within one or more image, identifying a first set of pixels and a second set of pixels, and modifying a color value for the first set of pixels.
-
公开(公告)号:US20250148816A1
公开(公告)日:2025-05-08
申请号:US18502868
申请日:2023-11-06
Applicant: Snap Inc.
Inventor: Maksim Gusarov , Kwot Sin Lee , Patrick Poirson , Chen Wang
IPC: G06V20/70 , G06F40/40 , G06N3/0455 , G06T11/00 , G06V10/774 , G06V20/20 , G06V20/40
Abstract: A second input image is generated by applying a target augmented reality (AR) effect to a first input image. The first input image and the second input image are provided to a first visual-semantic machine learning model to obtain output describing at least one feature of the target AR effect. The first visual-semantic machine learning model is fine-tuned from a second visual-semantic machine learning model by using training samples. Each training sample comprises a first training image, a second training image, and a training description of a given AR effect. The second training image is generated by applying the given AR effect to the first training image. A description of the target AR effect is selected based on the output of the visual-semantic machine learning model. The description of the target AR effect is stored in association with an identifier of the target AR effect.
-
公开(公告)号:US20250148218A1
公开(公告)日:2025-05-08
申请号:US18502679
申请日:2023-11-06
Applicant: Snap Inc.
Inventor: Maksim Gusarov , Kwot Sin Lee , Yanjia Li , Patrick Poirson , Chen Wang
Abstract: A first image and a second image are accessed. The second image is generated by applying an augmented reality (AR) effect to the first image. The first image, the second image, and a prompt are provided to a visual-semantic machine learning model to obtain output describing at least one feature of the AR effect. A description of the AR effect is generated based on the output of the visual-semantic machine learning model. The description of the AR effect is stored in association with an identifier of the AR effect.
-
公开(公告)号:US20250086466A1
公开(公告)日:2025-03-13
申请号:US18955297
申请日:2024-11-21
Applicant: Snap Inc.
Inventor: Sergey Tulyakov , Sergei Korolev , Aleksei Stoliar , Maksim Gusarov , Sergei Kotcur , Christopher Yale Crutchfield , Andrew Wan
IPC: G06N3/088 , G06F18/21 , G06F18/214 , G06N3/045 , G06N3/08 , G06V10/764 , G06V10/774 , G06V10/778 , G06V10/82
Abstract: A compact generative neural network can be distilled from a teacher generative neural network using a training network. The compact network can be trained on the input data and output data of the teacher network. The training network train the student network using a discrimination layer and one or more types of losses, such as perception loss and adversarial loss.
-
公开(公告)号:US12182722B2
公开(公告)日:2024-12-31
申请号:US18213145
申请日:2023-06-22
Applicant: Snap Inc.
Inventor: Sergey Tulyakov , Sergei Korolev , Aleksei Stoliar , Maksim Gusarov , Sergei Kotcur , Christopher Yale Crutchfield , Andrew Wan
IPC: G06N3/088 , G06F18/21 , G06F18/214 , G06N3/045 , G06N3/08 , G06V10/764 , G06V10/774 , G06V10/778 , G06V10/82
Abstract: A compact generative neural network can be distilled from a teacher generative neural network using a training network. The compact network can be trained on the input data and output data of the teacher network. The training network train the student network using a discrimination layer and one or more types of losses, such as perception loss and adversarial loss.
-
公开(公告)号:US20240355063A1
公开(公告)日:2024-10-24
申请号:US18304078
申请日:2023-04-20
Applicant: Snap Inc.
Inventor: Zhenpeng Zhou , Patrick Poirson , Maksim Gusarov , Chen Wang , Oleg Tovstyi
CPC classification number: G06T19/006 , G06T1/0021 , G06V10/761 , H04N5/2621
Abstract: An input video item that includes a target visual augmentation is accessed. A machine learning model uses the input video item to generate an embedding. The embedding may comprise a vector representation of a visual effect of the target visual augmentation. The machine learning model is trained, in an unsupervised training phase, to minimize loss between training video representations generated within each of a plurality of training sets. Each training set comprises a plurality of different training video items that each include a predefined visual augmentation. Based on the generation of the embedding of the input video item, the target visual augmentation is mapped to an augmentation identifier.
-
-
-
-
-
-
-
-
-