-
公开(公告)号：WO2023064244A1
公开(公告)日：2023-04-20
申请号：PCT/US2022/046234
申请日：2022-10-11
Applicant: SNAP INC.
Inventor： ZOHAR, Matan , BONDICH, Artem , ZHAO, Yanli , FULKERSON, Brian
Abstract: Methods and systems are disclosed for performing operations for deforming an external mesh. The operations comprise receiving a video that includes a depiction of a real -world object. The operations comprise generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real -world object across frames of the video. The operations comprise obtaining an external mesh associated with an Augmented-Reality (AR) element. The operations comprise accessing a plurality of deformation attributes associated with the external mesh, each attribute corresponding to a different deformation model. The operations comprise separately deforming, based on respective deformation models, a first portion of the external mesh and a second portion of the external mesh. The operations comprise modifying the video to include a display of the AR element based on the separately deformed first and second portions of the external mesh.
-
公开(公告)号：WO2023044151A1
公开(公告)日：2023-03-23
申请号：PCT/US2022/044113
申请日：2022-09-20
Applicant: SNAP INC.
Inventor： ZOHAR, Matan , ZHAO, Yanli , FULKERSON, Brian , GULER, Riza Alp
IPC: G06T19/20
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; determining UV positions of the real-world object depicted in the video to obtain pixel values associated with the UV positions; generating an external mesh and associated augmented reality (AR) element representing the real-world object based on the pixel values associated with the UV positions; deforming the external mesh based on changes to the 3D body mesh and a deformation parameter; and modifying the video to replace the real-world object with the AR element based on the deformed external mesh.
-
公开(公告)号：WO2023043790A1
公开(公告)日：2023-03-23
申请号：PCT/US2022/043456
申请日：2022-09-14
Applicant: SNAP INC.
Inventor： ZOHAR, Matan , ZHAO, Yanli , FULKERSON, Brian
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a real-world object; generating a three-dimensional (3D) body mesh associated with the real-world object that tracks movement of the real-world object across frames of the video; obtaining an external mesh associated with an augmented reality (AR) element; automatically establishing a correspondence between a portion of the 3D body mesh associated with the real-world object and the external mesh; blending the portion of the 3D body mesh into the external mesh according to a blending parameter; and as the portion of the 3D body mesh is being blended into the external mesh, modifying the video to depict a portion of the real-world object being changed into the AR element.
-
公开(公告)号：WO2023034832A1
公开(公告)日：2023-03-09
申请号：PCT/US2022/075707
申请日：2022-08-30
Applicant: SNAP INC.
Inventor： BERGER, Itamar , DUDOVITCH, Gal , SASSON, Gal , SHUVI, Ma'ayan , ZOHAR, Matan
IPC: G06T11/60
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a video that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the video; applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person; detecting a gesture performed by the person in the video; and modifying the one or more augmented reality elements that have been applied to the fashion item worn by the person based on the gesture performed by the person.
-
公开(公告)号：WO2022221243A2
公开(公告)日：2022-10-20
申请号：PCT/US2022/024364
申请日：2022-04-12
Applicant: SNAP INC.
Inventor： DUDOVITCH, Gal , HAREL, Peleg , MALBIN, Nir , SHUVI, Ma'ayan , ZOHAR, Matan
IPC: G06T7/11 , G06T7/174 , G06T11/00 , G06K9/6259 , G06N20/00 , G06N3/04 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084 , G06T2207/30124 , G06T2207/30196 , G06T5/002 , G06V40/103
Abstract: Methods and systems are disclosed for performing operations comprising: receiving a monocular image that includes a depiction of a user wearing a garment; generating a segmentation of the garment worn by the user in the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; smoothing, using the video feed, the segmentation of the garment worn by the user to provide a smoothed segmentation of the garment worn by the user; and applying one or more visual effects to the monocular image based on the smoothed segmentation garment worn by the user.
-
Patent Agency Ranking
公开(公告)号：WO2023070021A1
公开(公告)日：2023-04-27
申请号：PCT/US2022/078413
申请日：2022-10-20
Applicant: SNAP INC.
Inventor： ZOHAR, Matan , ZHAO, Yanli , FULKERSON, Brian , BERGER, Itamar
Abstract: Aspects of the present disclosure involve a system comprising a computer- readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person. The operations further include identifying a set of skeletal joints of the person. The operations further include identifying a pose of the person depicted in the video based on positioning of the set of skeletal joints (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device). The operations further include determining, based on the pose of the person (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device), that the video comprises a mirror reflection of the person. The operations further include, in response to determining that the video comprises the mirror reflection of the person, causing display of a 3D virtual object in the video.
-
公开(公告)号：WO2023064268A1
公开(公告)日：2023-04-20
申请号：PCT/US2022/046273
申请日：2022-10-11
Applicant: SNAP INC.
Inventor： ZOHAR, Matan , ZHAO, Yanli , FULKERSON, Brian , BERGER, Itamar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising receiving an image that depicts a person, identifying a set of skeletal joints of the person and identifying a pose of the person depicted in the image based on positioning of the set of skeletal joints. The operations also include receiving speech input comprising a request to perform an AR operation and an ambiguous intent, discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image and in response to receiving the speech input, performing the AR operation based on discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image.
-
公开(公告)号：WO2022093939A1
公开(公告)日：2022-05-05
申请号：PCT/US2021/056820
申请日：2021-10-27
Applicant: SNAP INC.
Inventor： ASSOULINE, Avihay , BERGER, Itamar , DUDOVITCH, Gal , ZOHAR, Matan
IPC: G11B27/031 , G06T7/70 , G06T13/40 , G06T19/00
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.
-
公开(公告)号：WO2021119408A1
公开(公告)日：2021-06-17
申请号：PCT/US2020/064476
申请日：2020-12-11
Applicant: SNAP INC.
Inventor： ASSOULINE, Avihay , BERGER, Itamar , DUDOVITCH, Gal , ZOHAR, Matan
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.
-
公开(公告)号：WO2023039183A1
公开(公告)日：2023-03-16
申请号：PCT/US2022/043094
申请日：2022-09-09
Applicant: SNAP INC.
Inventor： BERGER, Itamar , DUDOVITCH, Gal , SASSON, Gal , SHUVI, Ma'ayan , ZOHAR, Matan
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; identifying a facial expression of the user depicted in the image; and in response to identifying the facial expression, applying one or more augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.
-
-
-
-
-
-
-
-
-
Search Results
51
records
(took 0.029 seconds)
