TWO-WAY CONTROL OF IOT DEVICES USING AR CAMERA

    公开(公告)号:WO2023033985A1

    公开(公告)日:2023-03-09

    申请号:PCT/US2022/039471

    申请日:2022-08-04

    Applicant: SNAP INC.

    Abstract: Systems and methods for controlling Internet of Things (IoT) devices using an augmented reality (AR) camera are provided. The system includes a sensor and a server that receives an input from the sensor and presents an AR object on the display of the AR camera device that corresponds to the input from the sensor. A response to the displayed AR object from a user of the AR camera device is used to select a command to send to one or more IoT devices to perform an action corresponding to the user response to the displayed AR object. In an example, an AR smoke object is overlayed on the AR camera display in response to a smoke detection signal from a smoke detector. In response to the user swiping or gesturing to push away the AR smoke object, a window opening command is sent to one or more IoT enabled windows.

    CO-LOCATION CONNECTION SERVICE
    12.
    发明申请

    公开(公告)号:WO2022115308A1

    公开(公告)日:2022-06-02

    申请号:PCT/US2021/059895

    申请日:2021-11-18

    Applicant: SNAP INC.

    Abstract: An example co-location connection service is described. The online co-location connection service is provided by a messaging system configured to selectively pair user profiles associated with respective client devices equipped with sensors that communicate with each other within the predetermined physical range. The messaging system monitors physical proximity of the client devices based on the sensor data obtained by the co-location connection service from the respective messaging clients executing at the respective client devices. In response to detecting that the client devices are within a predetermined physical proximity range the messaging system generates co-location experience by modifying the user interface in the respective messaging clients.

    QR GENERATION SYSTEM FOR AUGMENTED REALITY CONTINUITY

    公开(公告)号:WO2022072311A1

    公开(公告)日:2022-04-07

    申请号:PCT/US2021/052303

    申请日:2021-09-28

    Applicant: SNAP INC.

    Abstract: Systems and Methods directed to detecting first user activity during a first session of an interactive augmented reality (AR) application on a first computing device, generating a quick response (QR) image comprising an encoded AR state associated with the first user activity, retrieving the QR image during a second session of the interactive AR application, and detecting selection of the QR image during the second session. The systems and methods are include generating an AR environment based on the encoded AR state in response to detecting the selection of the QR image, and causing an AR application interface associated with the interactive AR application to display the AR environment during the second session.

    AUGMENTED REALITY AUTO REACTIONS
    14.
    发明申请

    公开(公告)号:WO2022061362A1

    公开(公告)日:2022-03-24

    申请号:PCT/US2021/071494

    申请日:2021-09-16

    Applicant: SNAP INC.

    Abstract: Systems and methods herein describe generating automatic reactions in an augmented reality messenger system. The claimed systems and methods generate a contextual trigger defining a set of conditions at a first computing device, detect at least one of the set of conditions has been satisfied, cause presentation of an augmented reality content item at a second computing device, generate a user reaction in response to the presentation of the augmented reality content item and transmit the user reaction to a first computing device.

    WEARABLE DEVICE LOCATION ACCURACY SYSTEMS
    16.
    发明申请

    公开(公告)号:WO2020243591A1

    公开(公告)日:2020-12-03

    申请号:PCT/US2020/035354

    申请日:2020-05-29

    Applicant: SNAP INC.

    Abstract: Systems, methods, devices, computer readable media, and other various embodiments are described for location management processes in wearable electronic devices. One embodiment involves pairing a client device with a wearable device, capturing a first client location fix at a first time using the first application and location circuitry of the client device. The client device then receives content from the wearable device, where the content is associated with a content capture time and location state data. The client device then updates a location based on the available data to reconcile the different sets of location data. In some embodiments, additional sensor data, such as data from an accelerometer, is used is used to determine which location data is more accurate for certain content.

    SCAN-BASED MESSAGING FOR ELECTRONIC EYEWEAR DEVICES

    公开(公告)号:WO2023034025A1

    公开(公告)日:2023-03-09

    申请号:PCT/US2022/040634

    申请日:2022-08-17

    Applicant: SNAP INC.

    Abstract: Systems and methods are described for providing scan based imaging using an electronic eyewear device. The methods include scanning a scene using the electronic eyewear device to capture at least one image in an environment of a first user and identifying at least one physical marker in the scanned scene. Upon identification of the at least one physical marker in the scanned scene, a message (e.g., preselected AR content) is passively sent to at least one of directly to a second user or to at least one physical marker at a remote location for presentation to the second user. The message may be sent without use of the first user's hands to make a selection. The physical markers may be associated with a fixed object, a human face, a pet, a vehicle, a person, a logo, and the like.

    AUGMENTED REALITY PROP INTERACTIONS
    18.
    发明申请

    公开(公告)号:WO2023034017A1

    公开(公告)日:2023-03-09

    申请号:PCT/US2022/040443

    申请日:2022-08-16

    Applicant: SNAP INC.

    Abstract: Augmented reality (AR) systems, devices, media, and methods are described for generating AR experiences including interactions with virtual or physical prop objects. The AR experiences are generated by capturing images of a scene with a camera system, identifying an object receiving surface and corresponding surface coordinates within the scene, identifying an AR primary object and a prop object (physical or virtual), establishing a logical connection between the AR primary object and the prop object, generating AR overlays including actions associated with the AR primary object responsive to commands received via a user input system that position the AR primary object adjacent the object receiving surface responsive to the primary object coordinates and the surface coordinates within the scene and that position the AR primary object and the prop object with respect to one another in accordance with the logical connection, and presenting the generated AR overlays with a display system.

    HANDCRAFTED AUGMENTED REALITY EXPERIENCES
    19.
    发明申请

    公开(公告)号:WO2023034009A1

    公开(公告)日:2023-03-09

    申请号:PCT/US2022/040305

    申请日:2022-08-15

    Applicant: SNAP INC.

    Abstract: Augmented reality (AR) systems, devices, media, and methods are described for creating a handcrafted AR experience. The handcrafted AR experiences are created by capturing images of a scene, identifying an object receiving surface and corresponding surface coordinates, identifying a customizable AR primary object associated with at least one set of primary object coordinates, generating AR overlays including the customizable AR primary object for positioning adjacent the object receiving surface, presenting the AR overlays, receiving customization commands, generating handcrafted AR overlays including customizations associated with the customizable AR primary object responsive to the customization commands, presenting the handcrafted AR overlays, recording the handcrafted AR overlays, creating a handcrafted AR file including the recorded overlays, and transmitting the handcrafted AR file.

    CAMERA INTERFACES TO INTERACT WITH IOT DEVICES

    公开(公告)号:WO2023033970A1

    公开(公告)日:2023-03-09

    申请号:PCT/US2022/039155

    申请日:2022-08-02

    Applicant: SNAP INC.

    Abstract: Systems and methods for interfacing augmented reality (AR) camera devices to Internet of Things (IoT) devices include pairing an AR camera device to an IoT device to establish which actions recognized by the AR camera device may control the IoT device, receiving an action identifier representing a gesture or position of a body part that has been recognized by the AR camera device, and sending a command to the IoT device paired with the AR camera device to perform a requested action in response to the action identifier received from the AR camera device. Context information relating to the action identifier from the AR camera may be used to modify the command sent to the IoT device. The AR camera device may be paired with an IoT device pointed at by the AR camera device, selected through a user interface of the AR camera device, or determined from context information.

Patent Agency Ranking