公开(公告)号：US20230297161A1

公开(公告)日：2023-09-21

申请号：US17655125

申请日：2022-03-16

Applicant: Snap Inc.

Inventor： Sharon Moll

IPC: G06F3/01 ,  G06F3/16 ,  G06F3/04815 ,  G06T19/00

CPC classification number: G06F3/011 ,  G06F3/167 ,  G06F3/017 ,  G06F3/04815 ,  G06T19/003 ,  G06T19/006

Abstract: Feedback is provided to the user of an augmented or virtual reality device based on detecting the proximity of a user's hand to an interactive virtual object that is being displayed by the device. More particularly, a method of providing feedback in display device including a camera, comprises displaying a virtual object on the display device, tracking a user's hand in the field of view of the camera, determining proximity of the user's hand to the virtual object, and based on proximity of the user's hand to the virtual object, providing audible or visual user feedback to the user of the device.

公开(公告)号：US12288298B2

公开(公告)日：2025-04-29

申请号：US17845626

申请日：2022-06-21

Applicant: Snap Inc.

Inventor： Sharon Moll

IPC: G06F3/01 ,  G06F3/04815 ,  G06F3/0482 ,  G06T3/40 ,  G06T7/20 ,  G06T7/70 ,  G06T19/00

Abstract: An Augmented Reality (AR) graphics system is provided. The AR graphics system may detect an object in a real-world scene that corresponds to an AR graphics display surface. The AR graphics system may generate AR graphics that are displayed as overlays of the AR graphics display surface. The AR graphics system may track the motion of a graphics input tool with respect to the AR graphics display surface to generate AR graphics based on the motion of the graphics input tool. The AR graphics may be comprised of a number of markings generated based on the motion of the graphics input tool.

公开(公告)号：US20250097548A1

公开(公告)日：2025-03-20

申请号：US18970441

申请日：2024-12-05

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Dawei Zhang

IPC: H04N21/8545 ,  G06F3/04817 ,  G06K19/06

Abstract: A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.

公开(公告)号：US20240420484A1

公开(公告)日：2024-12-19

申请号：US18817024

申请日：2024-08-27

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Tomasz Zakrzewski

IPC: G06V20/58 ,  B60W30/18 ,  B60W40/105 ,  G06F1/16

Abstract: Disclosed is a method of providing a proximity warning using a head-worn device. A distance is determined between the head-worn device and a relevant object, such as a cyclist, jogger or vehicle, using image-processing techniques. A speed of the head-worn device is determined using a GPS receiver or other position components located in the head-worn device or an associated user device. A braking distance for the head-worn device is determined based on the speed of the head-worn device, and compared to the distance to the relevant object. A warning notification is provided by the head-worn device if the distance to the relevant object is less than the braking distance.

公开(公告)号：US20240411629A1

公开(公告)日：2024-12-12

申请号：US18810020

申请日：2024-08-20

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G06F9/54 ,  G06T19/00

Abstract: Systems, methods, and computer readable media are described for remotely changing settings on augmented reality (AR) wearable devices. Embodiments are disclosed that enable a user to change settings of an AR wearable device on a user interface (UI) provided by a host client device that can communicate wirelessly with the AR wearable device. The host client device and AR wearable device provide remote procedure calls (RPCs) and an application program interface (API) to access settings and determine if settings have been changed. The API enables the host client device to determine the settings on the AR wearable device without any prior knowledge of the settings on the AR wearable device. The RPCs and the API enable the host client device to automatically update the settings on the AR wearable device when the user changes the settings on the host client device.

公开(公告)号：US20240353835A1

公开(公告)日：2024-10-24

申请号：US18136166

申请日：2023-04-18

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G05D1/00 ,  B64U10/14 ,  G05D1/10 ,  G06T7/11 ,  G06T7/60 ,  G06T7/70 ,  G06V20/17 ,  G06V40/10 ,  H04N23/611 ,  H04N23/73

CPC classification number: G05D1/0094 ,  B64U10/14 ,  G06T7/11 ,  G06T7/60 ,  G06T7/70 ,  G06V20/17 ,  G06V40/11 ,  H04N23/611 ,  H04N23/73 ,  B64U2101/30 ,  B64U2201/10 ,  G06T2207/10032

Abstract: Apparatuses, computer readable medium, and methods for image capturing while circumnavigating objects using mobile devices are disclosed. Example methods include capturing an image, processing the image to identify an object within the image, determining a path around the object and a number of images to capture of the object, dividing the path by the number of images to determine a number of waypoints, and navigating the mobile device to the waypoints and capturing an image of the object at each waypoint of the waypoints. Examples include a person pointing at an object and the mobile device identifying the object based on the person pointing at the object. The mobile device determines a bounding box and a geometric center of the bounding box to determine the path to circumnavigate the object. The mobile device determines a height above a ground to assist in navigation.

公开(公告)号：US12086661B2

公开(公告)日：2024-09-10

申请号：US17929985

申请日：2022-09-06

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll

IPC: G06F9/54 ,  G06T19/00

CPC classification number: G06F9/547 ,  G06T19/006

Abstract: Systems, methods, and computer readable media are described for remotely changing settings on augmented reality (AR) wearable devices. Embodiments are disclosed that enable a user to change settings of an AR wearable device on a user interface (UI) provided by a host client device that can communicate wirelessly with the AR wearable device. The host client device and AR wearable device provide remote procedure calls (RPCs) and an application program interface (API) to access settings and determine if settings have been changed. The API enables the host client device to determine the settings on the AR wearable device without any prior knowledge of the settings on the AR wearable device. The RPCs and the API enable the host client device to automatically update the settings on the AR wearable device when the user changes the settings on the host client device.

公开(公告)号：US20240193982A1

公开(公告)日：2024-06-13

申请号：US18063489

申请日：2022-12-08

Applicant: Snap Inc.

Inventor： Piotr Gurgul ,  Sharon Moll ,  Pawel Wawruch

IPC: G06V40/10 ,  G02B27/01 ,  G06T7/246 ,  G06T7/73 ,  G06V20/20 ,  G06V20/40 ,  H04N23/20

CPC classification number: G06V40/11 ,  G02B27/0101 ,  G02B27/017 ,  G06T7/251 ,  G06T7/75 ,  G06V20/20 ,  G06V20/46 ,  H04N23/20 ,  G02B2027/0138 ,  G02B2027/014 ,  G06T2207/10048 ,  G06T2207/30196

Abstract: An extended Reality (XR) system provides methodologies for capturing hand poses being made by a user in low-light environments. The XR system capture, using one or more visible light cameras, tracking video frame data of a hand pose of a user of the XR system. The XR system generates hand-tracking data based on the tracking video frame data. The hand-tracking data includes a skeletal model and a hand-tracking confidence level indicating a probability that the skeletal model matches the hand pose. The XR system compares the hand-tracking confidence level to a threshold confidence value, and based on determining the first hand-tracking confidence level is below the threshold confidence value, activates one or more wide-spectrum cameras to capture subsequent tracking video frame data of the hand pose. The XR system may also activate an IR light emitter to illuminate the hands of the user.

公开(公告)号：US11988841B2

公开(公告)日：2024-05-21

申请号：US17816914

申请日：2022-08-02

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Piotr Gurgul ,  Tomasz Zakrzewski

IPC: G02B27/01 ,  G06F3/01 ,  G06F3/16 ,  G06T19/00

CPC classification number: G02B27/0176 ,  G06F3/016 ,  G06F3/167 ,  G06T19/006 ,  G02B2027/0138

Abstract: Systems, methods, and computer readable media for voice input for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. A keyword is used to indicate that the user is about to speak an action or command. The AR wearable device divides the processing of the audio data into a keyword module that is trained to recognize the keyword and a module to process the audio data after the keyword. In some embodiments, the AR wearable device transmits the audio data after the keyword to a host device to process. The AR wearable device maintains an application registry that associates actions with applications. Applications can be downloaded, and the application registry updated where the applications indicate actions to associate with the application.

公开(公告)号：US20240139611A1

公开(公告)日：2024-05-02

申请号：US18050381

申请日：2022-10-27

Applicant: Snap Inc.

Inventor： Sharon Moll ,  Pawel Wawruch ,  Piotr Gurgul

IPC: A63F1/04 ,  A63F1/02 ,  G06F3/01

CPC classification number: A63F1/04 ,  A63F1/02 ,  G06F3/011 ,  G06F3/017 ,  A63F2001/008

Abstract: Systems, methods, and computer readable media for augmented reality (AR) physical card games. Examples capture an image of a user view of a real-world scene and process the image to determine the locations and codes of physical cards within the image. Overlays are determined for the cards based on the codes. An AR graphics component displays on a display of an AR wearable device the overlays adjusted in accordance with the user view. The overlays may be images, animations, or videos. A card game is downloaded onto the AR wearable device. The card game includes rules that keep track of a score, assist with play, and insure fair play. The card game includes user interfaces that may be shared among the players. Methods include manufacturing the playing cards with computer-readable codes to identify the cards.