-
公开(公告)号:US12212820B2
公开(公告)日:2025-01-28
申请号:US18440603
申请日:2024-02-13
Applicant: Snap Inc.
Inventor: Sharon Moll , Piotr Gurgul , Dawei Zhang
IPC: H04N21/8545 , G06F3/04817 , G06K19/06
Abstract: A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.
-
公开(公告)号:US20240264452A1
公开(公告)日:2024-08-08
申请号:US18639566
申请日:2024-04-18
Applicant: Snap Inc.
Inventor: Sharon Moll , Piotr Gurgul , Tomasz Zakrzewski
CPC classification number: G02B27/0176 , G06F3/016 , G06F3/167 , G06T19/006 , G02B2027/0138
Abstract: Systems, methods, and computer readable media for voice input for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. A keyword is used to indicate that the user is about to speak an action or command. The AR wearable device divides the processing of the audio data into a keyword module that is trained to recognize the keyword and a module to process the audio data after the keyword. In some embodiments, the AR wearable device transmits the audio data after the keyword to a host device to process. The AR wearable device maintains an application registry that associates actions with applications. Applications can be downloaded, and the application registry updated where the applications indicate actions to associate with the application.
-
公开(公告)号:US20240231970A9
公开(公告)日:2024-07-11
申请号:US18049174
申请日:2022-10-24
Applicant: Snap Inc.
Inventor: Adithya Gajulapally , Piotr Gurgul , Andrew Ly , Sharon Moll
IPC: G06F9/54 , H04L67/133
CPC classification number: G06F9/547 , H04L67/133
Abstract: Systems, methods, and computer readable media for a service manger to manage services on a wearable device are disclosed. The service manager remains active in memory and listens for requests for services. The service manager then determines which services to run and which to stop to respond to the requests for services. After running a service, the service manager calls the service to respond to the request and sends a response to the request to the sender of the request. The service manager may be resident on a different processor than a processor from which the requests for services originate. The service manager maintains priorities of the services to determine which services to stop or remove from memory.
-
公开(公告)号:US12001878B2
公开(公告)日:2024-06-04
申请号:US17831949
申请日:2022-06-03
Applicant: Snap Inc.
Inventor: Piotr Gurgul
CPC classification number: G06F9/4856 , G02B27/0172 , G06F3/14 , G02B2027/014 , G02B2027/0178
Abstract: Systems, methods, and computer readable media for auto-recovery of an augmented reality (AR) wearable device are disclosed. A pass-through application is invoked as a background process and an application is invoked as a foreground process. The pass-through application includes an on-resume procedure that is called if the operating system or interpreter determines that the foreground process is unresponsive. The on-resume procedure restarts the application as the foreground process and may first reboot the AR wearable device. The pass-through application remains transparent to the user by not displaying output on the display of the AR wearable device. Additionally, an uncaught exception handler is registered with the operating system to be called in the event that an exception occurs that does not have a handler. The exception handler restarts the application as the foreground process and may first reboot the AR wearable device.
-
公开(公告)号:US20240078147A1
公开(公告)日:2024-03-07
申请号:US17929985
申请日:2022-09-06
Applicant: Snap Inc.
Inventor: Piotr Gurgul , Sharon Moll
CPC classification number: G06F9/547 , G06T19/006
Abstract: Systems, methods, and computer readable media are described for remotely changing settings on augmented reality (AR) wearable devices. Embodiments are disclosed that enable a user to change settings of an AR wearable device on a user interface (UI) provided by a host client device that can communicate wirelessly with the AR wearable device. The host client device and AR wearable device provide remote procedure calls (RPCs) and an application program interface (API) to access settings and determine if settings have been changed. The API enables the host client device to determine the settings on the AR wearable device without any prior knowledge of the settings on the AR wearable device. The RPCs and the API enable the host client device to automatically update the settings on the AR wearable device when the user changes the settings on the host client device.
-
公开(公告)号:US20240045217A1
公开(公告)日:2024-02-08
申请号:US17816914
申请日:2022-08-02
Applicant: Snap Inc.
Inventor: Sharon Moll , Piotr Gurgul , Tomasz Zakrzewski
CPC classification number: G02B27/0176 , G06F3/016 , G06T19/006 , G02B2027/0138
Abstract: Systems, methods, and computer readable media for voice input for augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable a user to interact with the AR wearable device without using physical user interface devices. A keyword is used to indicate that the user is about to speak an action or command. The AR wearable device divides the processing of the audio data into a keyword module that is trained to recognize the keyword and a module to process the audio data after the keyword. In some embodiments, the AR wearable device transmits the audio data after the keyword to a host device to process. The AR wearable device maintains an application registry that associates actions with applications. Applications can be downloaded, and the application registry updated where the applications indicate actions to associate with the application.
-
公开(公告)号:US20230393890A1
公开(公告)日:2023-12-07
申请号:US17831949
申请日:2022-06-03
Applicant: Snap Inc.
Inventor: Piotr Gurgul
CPC classification number: G06F9/4856 , G06F3/14 , G02B27/0172 , G02B2027/0178 , G02B2027/014
Abstract: Systems, methods, and computer readable media for auto-recovery of an augmented reality (AR) wearable device are disclosed. A pass-through application is invoked as a background process and an application is invoked as a foreground process. The pass-through application includes an on-resume procedure that is called if the operating system or interpreter determines that the foreground process is unresponsive. The on-resume procedure restarts the application as the foreground process and may first reboot the AR wearable device. The pass-through application remains transparent to the user by not displaying output on the display of the AR wearable device. Additionally, an uncaught exception handler is registered with the operating system to be called in the event that an exception occurs that does not have a handler. The exception handler restarts the application as the foreground process and may first reboot the AR wearable device.
-
公开(公告)号:US20230215107A1
公开(公告)日:2023-07-06
申请号:US17651147
申请日:2022-02-15
Applicant: Snap Inc.
Inventor: Piotr Gurgul , Tomasz Zakrzewski
CPC classification number: G06T19/006 , G06F3/017 , H04W4/80
Abstract: Systems, methods, and computer readable media for enhanced augmented reality (AR) reading are provided, where the methods include entering a reading mode, capturing an image of a section of reading materials such as a page of a book, identifying a code within the image, and identifying a code module corresponding to the code. The methods further include executing the code module, the code module providing an augmented reality object or virtual reality object related to an object depicted on the section or page, entering a sleep mode for a sleep duration based on an estimated reading time duration of a section or page, awaking after the sleep duration, and capturing a next image. The sleep duration is adjusted based on times when identifiers of the sections of the reading materials such as numbers are captured. The user may manually wake the AR reading device using an external user interface.
-
公开(公告)号:US12266057B2
公开(公告)日:2025-04-01
申请号:US17830708
申请日:2022-06-02
Applicant: Snap Inc.
Inventor: Piotr Gurgul , Sharon Moll
IPC: G06T19/00 , G06F1/16 , G06F3/01 , G06K19/077 , G06V10/82
Abstract: Systems, methods, and computer readable media for input modalities for an augmented reality (AR) wearable device are disclosed. The AR wearable device captures images using an image capturing device and processes the images to identify objects. The objects may be people, places, things, and so forth. The AR wearable device associates the objects with tags such as the name of the object or a function that can be provided by the selection of the object. The AR wearable device then matches the tags of the objects with tags associated with AR applications. The AR wearable device presents on a display of the AR wearable device indications of the AR applications with matching tags, which provides a user with the opportunity to invoke one of the AR applications. The AR wearable device recognizes a selection of an AR application in a number of different ways including gesture recognition and voice commands.
-
公开(公告)号:US12265663B2
公开(公告)日:2025-04-01
申请号:US17657911
申请日:2022-04-04
Applicant: Snap Inc.
Inventor: Sharon Moll , Piotr Gurgul , Francis Patrick Sullivan , Andrei Rybin
IPC: G06F3/01 , G06F3/0482
Abstract: A head-worn device system includes one or more cameras, one or more display devices and one or more processors. The system also includes a memory storing instructions that, when executed by the one or more processors, configure the system to detect a gesture made by a user of the computing apparatus and generate gesture data identifying the gesture, select an application or selected action from a set of registered applications and actions based on the gesture data, and invoke the application or selected action.
-
-
-
-
-
-
-
-
-