AUGMENTED REALITY PRECISION TRACKING AND DISPLAY

    公开(公告)号:WO2022146673A1

    公开(公告)日:2022-07-07

    申请号:PCT/US2021/063295

    申请日:2021-12-14

    Applicant: SNAP INC.

    Inventor: BROWN, Ted

    Abstract: Example systems, devices, media, and methods are described for tracking one or more movable objects and presenting virtual elements on a display in proximity to the tracked movable objects. One or more ultra-wideband (UWB) transmitters are mounted to each movable object in a physical environment including at least two synchronized UWB receivers. The receivers calculate a current location of each movable object. A plurality of portable electronic devices, including one or more eyewear devices, are paired with the receivers in a network. A localization application determines a current location of each eyewear device. A rendering application presents one or more virtual elements on a display as an overlay relative to the current movable object location and in relative proximity to the current eyewear location. The physical environment is represented by a static mesh. A time synchronized tracking application identifies moving items that are not coupled to a UWB transmitter. The rendering application presents the virtual elements on the display in accordance with the static mesh and the moving items.

    TIMING ADVERTISING TO USER RECEPTIVITY
    52.
    发明申请

    公开(公告)号:WO2022132384A1

    公开(公告)日:2022-06-23

    申请号:PCT/US2021/060031

    申请日:2021-11-19

    Applicant: SNAP INC.

    Abstract: A processor collecting advertisement (ad) events of a user using a mobile device, such as a mobile phone or eyewear, parsing the ad events from the mobile device, and generating an ad receptivity profile on the granularity of a user identification (ID) and an hour of day. In one example, the processor computes the percentage of ad time watched by the individual user, such as on an hourly basis, and by monitoring a click-through rate (CTR) of the respective user as a measure for user ad receptivity. The processor adjusts an ad allocation/ad load on a per user basis according to the user level ad receptivity profile, resulting in dynamically providing ads on the mobile device display when a user is active and receptive viewing the ads.

    EYEWEAR INCLUDING A PUSH-PULL LENS SET
    53.
    发明申请

    公开(公告)号:WO2022132344A1

    公开(公告)日:2022-06-23

    申请号:PCT/US2021/058804

    申请日:2021-11-10

    Applicant: SNAP INC.

    Inventor: SCHUCK, Miller

    Abstract: Eyewear having a stereoscopic display including a lens system, and a push-pull lens set including prisms to produce a binocular overlap of two images that coincides with an accommodation plane. The overlap of two virtual images generated by a respective display as seen by the user's two eyes provides user comfort. The stereoscopic display may have a single accommodation plane, where the binocular overlap of the two virtual images depends on the location of the accommodation plane and the depth of the content formed by disparity in the two images. By providing the content at or near the location where the virtual images are at least substantially overlapped, the user viewing comfort is improved. The binocular overlap is controlled by tilting or steering the virtual images inward, such that the overlap occurs at the accommodation plane.

    FACE ANIMATION SYNTHESIS
    54.
    发明申请

    公开(公告)号:WO2022115325A1

    公开(公告)日:2022-06-02

    申请号:PCT/US2021/060079

    申请日:2021-11-19

    Applicant: SNAP INC.

    Abstract: In some embodiments, users experience of engaging with augmented reality technology is enhanced by providing a process, referred to as face animation synthesis, that replaces an actors face in the frames of a video with a users face from the users portrait image. The resulting face in the frames of the video retains the facial expressions, as well as color and lighting, of the actors face but, at the same time, has the likeness of the users face. An example face animation synthesis experience can be made available to uses of a messaging system by providing a face animation synthesis augmented reality component.

    CO-LOCATION CONNECTION SERVICE
    55.
    发明申请

    公开(公告)号:WO2022115308A1

    公开(公告)日:2022-06-02

    申请号:PCT/US2021/059895

    申请日:2021-11-18

    Applicant: SNAP INC.

    Abstract: An example co-location connection service is described. The online co-location connection service is provided by a messaging system configured to selectively pair user profiles associated with respective client devices equipped with sensors that communicate with each other within the predetermined physical range. The messaging system monitors physical proximity of the client devices based on the sensor data obtained by the co-location connection service from the respective messaging clients executing at the respective client devices. In response to detecting that the client devices are within a predetermined physical proximity range the messaging system generates co-location experience by modifying the user interface in the respective messaging clients.

    PERSONALIZED AVATAR REAL-TIME MOTION CAPTURE
    56.
    发明申请

    公开(公告)号:WO2022108805A1

    公开(公告)日:2022-05-27

    申请号:PCT/US2021/058800

    申请日:2021-11-10

    Applicant: SNAP INC.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing at least one program, and a method for performing operations comprising: capturing a video that depicts a person; identifying a set of skeletal joints of the person depicted in the video; storing a movement vector representing previously captured three-dimensional (3D) movement of the set of skeletal joints of the person depicted in the video; receiving input that selects a 3D avatar; and animating, based on the movement vector, the 3D avatar to mimic the previously captured 3D movement of the set of skeletal joints of the person depicted in the video.

    TOKENS IN A MESSAGING APPLICATION
    57.
    发明申请

    公开(公告)号:WO2022103972A1

    公开(公告)日:2022-05-19

    申请号:PCT/US2021/058995

    申请日:2021-11-11

    Applicant: SNAP INC.

    Abstract: Aspects of the present disclosure involve a system and a method for performing operations comprising: receiving, by a messaging application, content from a given user; selecting a metric for measuring performance of the content on the messaging application; measuring performance of the content on the messaging application; computing a value of the performance of the content on the messaging application based on the selected metric; and updating a restricted use token wallet stored in a profile for the given user based on the computed value of the performance of the content.

    AUGMENTED REALITY CONTENT GENERATORS FOR IDENTIFYING GEOLOCATIONS

    公开(公告)号:WO2022072983A1

    公开(公告)日:2022-04-07

    申请号:PCT/US2021/071570

    申请日:2021-09-23

    Applicant: SNAP INC.

    Abstract: The subject technology causes display, at the client device, a set of augmented reality content items generated by the first augmented reality content generator. The subject technology receives, at the client device, a second selection of the particular augmented reality content item corresponding to the destination geolocation. The subject technology causes display, at the client device, a second set of augmented reality content items generated by the first augmented reality content generator. The subject technology receives, at the client device, a second selection of the second set of augmented reality content items. The subject technology causes display, at the client device, a third set of augmented reality content items generated by the first augmented reality content generator, the third set of augmented reality content items comprising at least one activity or location associated with the destination geolocation and a selected period of time.

    VIDEO SYNTHESIS WITHIN A MESSAGING SYSTEM
    59.
    发明申请

    公开(公告)号:WO2022072725A1

    公开(公告)日:2022-04-07

    申请号:PCT/US2021/053012

    申请日:2021-09-30

    Applicant: SNAP INC.

    Abstract: Aspects of the present disclosure involve a system comprising a computer-readable storage medium storing a program and method for video synthesis. The program and method provide for accessing a primary generative adversarial network (GAN) comprising a pre-trained image generator, a motion generator comprising a plurality of neural networks, and a video discriminator; generating an updated GAN based on the primary GAN, by performing operations comprising identifying input data of the updated GAN, the input data comprising an initial latent code and a motion domain dataset, training the motion generator based on the input data, and adjusting weights of the plurality of neural networks of the primary GAN based on an output of the video discriminator; and generating a synthesized video based on the primary GAN and the input data.

Patent Agency Ranking