-
公开(公告)号:WO2023070021A1
公开(公告)日:2023-04-27
申请号:PCT/US2022/078413
申请日:2022-10-20
Applicant: SNAP INC.
Inventor: ZOHAR, Matan , ZHAO, Yanli , FULKERSON, Brian , BERGER, Itamar
Abstract: Aspects of the present disclosure involve a system comprising a computer- readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person. The operations further include identifying a set of skeletal joints of the person. The operations further include identifying a pose of the person depicted in the video based on positioning of the set of skeletal joints (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device). The operations further include determining, based on the pose of the person (or detecting a hand pose, detecting a mirror frame, or detecting a mobile device), that the video comprises a mirror reflection of the person. The operations further include, in response to determining that the video comprises the mirror reflection of the person, causing display of a 3D virtual object in the video.
-
公开(公告)号:WO2023064268A1
公开(公告)日:2023-04-20
申请号:PCT/US2022/046273
申请日:2022-10-11
Applicant: SNAP INC.
Inventor: ZOHAR, Matan , ZHAO, Yanli , FULKERSON, Brian , BERGER, Itamar
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising receiving an image that depicts a person, identifying a set of skeletal joints of the person and identifying a pose of the person depicted in the image based on positioning of the set of skeletal joints. The operations also include receiving speech input comprising a request to perform an AR operation and an ambiguous intent, discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image and in response to receiving the speech input, performing the AR operation based on discerning the ambiguous intent of the speech input based on the pose of the person depicted in the image.
-
公开(公告)号:WO2022093939A1
公开(公告)日:2022-05-05
申请号:PCT/US2021/056820
申请日:2021-10-27
Applicant: SNAP INC.
Inventor: ASSOULINE, Avihay , BERGER, Itamar , DUDOVITCH, Gal , ZOHAR, Matan
IPC: G11B27/031 , G06T7/70 , G06T13/40 , G06T19/00
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; tracking three-dimensional (3D) movement of the person within the video using a 3D reference point; computing a 3D position for placement of an augmented reality item relative to the 3D reference point; causing to be displayed the augmented reality item within the video at the 3D position; and updating the 3D position of the augmented reality item in the video as the 3D reference point changes based on the 3D movement of the person.
-
公开(公告)号:WO2021119408A1
公开(公告)日:2021-06-17
申请号:PCT/US2020/064476
申请日:2020-12-11
Applicant: SNAP INC.
Inventor: ASSOULINE, Avihay , BERGER, Itamar , DUDOVITCH, Gal , ZOHAR, Matan
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for detecting a pose of a user. The program and method include operations comprising receiving a monocular image that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body based on the monocular image; accessing a video feed comprising a plurality of monocular images received prior to the monocular image; filtering, using the video feed, the plurality of skeletal joints of the body detected based on the monocular image; and determining a pose represented by the body depicted in the monocular image based on the filtered plurality of skeletal joints of the body.
-
公开(公告)号:WO2023039390A1
公开(公告)日:2023-03-16
申请号:PCT/US2022/076006
申请日:2022-09-07
Applicant: SNAP INC.
Inventor: BERGER, Itamar , DUDOVITCH, Gal , SASSON, Gal , SHUVI, Ma'ayan , ZOHAR, Matan
IPC: A63F13/63 , A63F13/79 , G06F3/01 , G06N3/00 , G06N3/08 , G06Q30/06 , G06T7/00 , G06T19/00 , G06V20/20 , G06V40/10
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a person wearing a fashion item; generating a segmentation of the fashion item worn by the person depicted in the image; generating one or more game-based augmented reality elements; and applying the one or more game-based augmented reality elements to the fashion item worn by the person based on the segmentation of the fashion item worn by the person.
-
公开(公告)号:WO2022246425A1
公开(公告)日:2022-11-24
申请号:PCT/US2022/072405
申请日:2022-05-18
Applicant: SNAP INC.
Inventor: BERGER, Itamar , BOGHANI, Amar , GARCIA SOPO, Maria, Jose , MÜLLER SANDVIK, Isac, Andreas , PAN, Qi , ZOHAR, Matan
Abstract: Aspects of the present disclosure involve a system comprising a computer- readable storage medium storing a program and a method for performing operations comprising: receiving a request from a client device of a first user to engage in a shared augmented reality (AR) shopping experience with a second user; generating, for display on respective client devices of the first and second users, the shared AR shopping experience comprising a plurality of AR items that represent real-world products overlaid on a shared real-world environment of the first and second users; determining that the second user is interacting with a first AR item of the plurality of AR items; and in response to detecting that the second user is depicted in an image captured by the client device of the first user, overlaying the first AR item on the second user in the image.
-
公开(公告)号:WO2022204031A1
公开(公告)日:2022-09-29
申请号:PCT/US2022/021151
申请日:2022-03-21
Applicant: SNAP INC.
Inventor: ASSOULINE, Avihay , BERGER, Itamar , LUO, Jean , ZOHAR, Matan
IPC: G06V40/16
Abstract: Methods and systems are disclosed for performing operations comprising: receiving an image that includes a depiction of a face of a user; generating a plurality of landmarks of the face based on the received image; removing a set of interfering landmarks from the plurality of landmarks resulting in a remaining set of landmarks of the plurality of landmarks; obtaining a depth map for the face of the user; and computing a real-world scale of the face of the user based on the depth map and the remaining set of landmarks.
-
公开(公告)号:WO2022108807A1
公开(公告)日:2022-05-27
申请号:PCT/US2021/058816
申请日:2021-11-10
Applicant: SNAP INC.
Inventor: ASSOULINE, Avihay , BERGER, Itamar , DUDOVITCH, Gal , ZOHAR, Matan
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving a video that depicts a person; identifying a set of skeletal joints corresponding to limbs of the person; tracking 3D movement of the set of skeletal joints corresponding to the limbs of the person in the video; causing display of a 3D virtual object that has a plurality of limbs including one or more extra limbs than the limbs of the person in the video; and moving the one or more extra limbs of the 3D virtual object based on the movement of the set of skeletal joints corresponding to the limbs of the person in the video.
-
公开(公告)号:WO2022108806A1
公开(公告)日:2022-05-27
申请号:PCT/US2021/058811
申请日:2021-11-10
Applicant: SNAP INC.
Inventor: ASSOULINE, Avihay , BERGER, Itamar , DUDOVITCH, Gal , ZOHAR, Matan
IPC: G06T13/40
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: receiving, by a client device associated with a first user, a communication from a second user; retrieving, from the communication, a movement vector representing three-dimensional (3D) movement of a set of skeletal joints of the second user; receiving, by the client device associated with the first user, input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the 3D movement of the set of skeletal joints of the second user.
-
公开(公告)号:WO2022093958A1
公开(公告)日:2022-05-05
申请号:PCT/US2021/056850
申请日:2021-10-27
Applicant: SNAP INC.
Inventor: ASSOULINE, Avihay , BERGER, Itamar , DUDOVITCH, Gal , ZOHAR, Matan
Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and a method for performing operations comprising: receiving a video that includes a depiction of a body of a user; detecting a plurality of skeletal joints of the body depicted in the video; tracking movement of the plurality of skeletal joints across a set of frames of the video; and smoothing the movement of a first set of the plurality of skeletal joints between frames in the first set of frames independently of smoothing movement of a second set of the plurality of skeletal joints in the first set of frames.
-
-
-
-
-
-
-
-
-