-
公开(公告)号:US11949969B1
公开(公告)日:2024-04-02
申请号:US17956603
申请日:2022-09-29
Applicant: Snap Inc.
Inventor: Sharon Moll , Piotr Gurgul , Dawei Zhang
IPC: H04N21/8545 , G06F3/04817 , G06K19/06
CPC classification number: H04N21/8545 , G06F3/04817 , G06K19/06037
Abstract: A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.
-
公开(公告)号:US20230315208A1
公开(公告)日:2023-10-05
申请号:US17657911
申请日:2022-04-04
Applicant: Snap Inc.
Inventor: Sharon Moll , Piotr Gurgul , Francis Patrick Sullivan , Andrei Rybin
IPC: G06F3/01 , G06F3/0482
CPC classification number: G06F3/017 , G06F3/0482
Abstract: A head-worn device system includes one or more cameras, one or more display devices and one or more processors. The system also includes a memory storing instructions that, when executed by the one or more processors, configure the system to detect a gesture made by a user of the computing apparatus and generate gesture data identifying the gesture, select an application or selected action from a set of registered applications and actions based on the gesture data, and invoke the application or selected action.
-
公开(公告)号:US12266057B2
公开(公告)日:2025-04-01
申请号:US17830708
申请日:2022-06-02
Applicant: Snap Inc.
Inventor: Piotr Gurgul , Sharon Moll
IPC: G06T19/00 , G06F1/16 , G06F3/01 , G06K19/077 , G06V10/82
Abstract: Systems, methods, and computer readable media for input modalities for an augmented reality (AR) wearable device are disclosed. The AR wearable device captures images using an image capturing device and processes the images to identify objects. The objects may be people, places, things, and so forth. The AR wearable device associates the objects with tags such as the name of the object or a function that can be provided by the selection of the object. The AR wearable device then matches the tags of the objects with tags associated with AR applications. The AR wearable device presents on a display of the AR wearable device indications of the AR applications with matching tags, which provides a user with the opportunity to invoke one of the AR applications. The AR wearable device recognizes a selection of an AR application in a number of different ways including gesture recognition and voice commands.
-
公开(公告)号:US12265663B2
公开(公告)日:2025-04-01
申请号:US17657911
申请日:2022-04-04
Applicant: Snap Inc.
Inventor: Sharon Moll , Piotr Gurgul , Francis Patrick Sullivan , Andrei Rybin
IPC: G06F3/01 , G06F3/0482
Abstract: A head-worn device system includes one or more cameras, one or more display devices and one or more processors. The system also includes a memory storing instructions that, when executed by the one or more processors, configure the system to detect a gesture made by a user of the computing apparatus and generate gesture data identifying the gesture, select an application or selected action from a set of registered applications and actions based on the gesture data, and invoke the application or selected action.
-
公开(公告)号:US20250095304A1
公开(公告)日:2025-03-20
申请号:US18959194
申请日:2024-11-25
Applicant: Snap Inc.
Inventor: Piotr Gurgul , Sharon Moll , Tomasz Zakrzewski
Abstract: Systems, methods, and computer readable media for object counting on augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable display of a count of objects as part of a user view. Upon receipt of a request to count objects, the AR wearable device captures an image of the user view. The AR wearable device transmits the image to a backend for processing to determine the objects in the image. The AR wearable device selects a group of objects of the determined objects to count and overlays boundary boxes over counted objects within the user view. The position of the boundary boxes is adjusted to account for movement of the AR wearable device. A hierarchy of objects is used to group together objects that are related but have different labels or names.
-
公开(公告)号:US20250068326A1
公开(公告)日:2025-02-27
申请号:US18944816
申请日:2024-11-12
Applicant: Snap Inc.
Inventor: Sharon Moll , Dawei Zhang
IPC: G06F3/04886 , G06F3/01 , G06F3/042
Abstract: A gesture-based text entry user interface for an Augmented Reality (AR) system is provided. The AR system detects a start text entry gesture made by a user of the AR system, generates a virtual keyboard user interface including a virtual keyboard having a plurality of virtual keys, and provides to the user the virtual keyboard user interface. The AR system detects a hold of an enter text gesture made by the user. While the user holds the enter text gesture, the AR system collects continuous motion gesture data of a continuous motion as the user makes the continuous motion through the virtual keys of the virtual keyboard. The AR system detects a release of the enter text gesture by the user and generates entered text data based on the continuous motion gesture data.
-
公开(公告)号:US20240187711A1
公开(公告)日:2024-06-06
申请号:US18440603
申请日:2024-02-13
Applicant: Snap Inc.
Inventor: Sharon Moll , Piotr Gurgul , Dawei Zhang
IPC: H04N21/8545 , G06F3/04817 , G06K19/06
CPC classification number: H04N21/8545 , G06F3/04817 , G06K19/06037
Abstract: A mixed-reality media content system may be configured to perform operations that include: causing display of image data at a client device, the image data comprising a depiction of an object that includes a graphical code at a position upon the object; detecting the graphical code at the position upon the depiction of the object based on the image data; accessing media content within a media repository based on the graphical code scanned by the client device; and causing display of a presentation of the media content at the position of the graphical code upon the depiction of the object at the client device.
-
公开(公告)号:US20240144673A1
公开(公告)日:2024-05-02
申请号:US18050360
申请日:2022-10-27
Applicant: Snap Inc.
Inventor: Sharon Moll , Piotr Gurgul
IPC: G06V20/10 , G06T7/20 , G06T19/00 , G06V10/764
CPC classification number: G06V20/188 , G06T7/20 , G06T19/006 , G06V10/764 , G06T2207/30188
Abstract: An augmented reality (AR) plant content system is provided. The AR plant content system may detect an object in a real world scene that corresponds to a plant. The AR plant content system may generate care instructions for the plant that include AR graphics that are displayed as overlays of the real world scene. The AR plant content system may also track the motion of objects in the real world scene to determine that plant care events have taken place, such as watering the plant or pruning the plant. A plant inventory may be produced that includes care instructions and a log of plant care events for plants that correspond to one or more users.
-
公开(公告)号:US20240096031A1
公开(公告)日:2024-03-21
申请号:US17947889
申请日:2022-09-19
Applicant: Snap Inc.
Inventor: Piotr Gurgul , Sharon Moll
CPC classification number: G06T19/006 , G02B27/0172 , G06T7/70 , G06T19/20 , G06V10/761 , G06V20/20 , G02B2027/0178 , G06T2219/2004 , G06T2219/2016
Abstract: Systems, methods, and computer readable media for graphical assistance with tasks using an augmented reality (AR) wearable devices are disclosed. Embodiments capture an image of a first user view of a real-world scene and access indications of surfaces and locations of the surfaces detected in the image. The AR wearable device displays indications of the surfaces on a display of the AR wearable device where the locations of the indications are based on the locations of the surfaces and a second user view of the real-world scene. The locations of the surfaces are indicated with 3D world coordinates. The user views are determined based on a location of the user. The AR wearable device enables a user to add graphics to the surfaces and select tasks to perform. Tools such as a bubble level or a measuring tool are available for the user to utilize to perform the task.
-
公开(公告)号:US20240070996A1
公开(公告)日:2024-02-29
申请号:US17893738
申请日:2022-08-23
Applicant: Snap Inc.
Inventor: Piotr GURGUL , Sharon Moll , Tomasz Zakrzewski
CPC classification number: G06T19/006 , G06F3/011 , G06T7/73 , G06V20/53 , G06V20/68 , G06T2200/16 , G06T2200/24 , G06T2207/30242 , G06T2210/12
Abstract: Systems, methods, and computer readable media for object counting on augmented reality (AR) wearable devices are disclosed. Embodiments are disclosed that enable display of a count of objects as part of a user view. Upon receipt of a request to count objects, the AR wearable device captures an image of the user view. The AR wearable device transmits the image to a backend for processing to determine the objects in the image. The AR wearable device selects a group of objects of the determined objects to count and overlays boundary boxes over counted objects within the user view. The position of the boundary boxes is adjusted to account for movement of the AR wearable device. A hierarchy of objects is used to group together objects that are related but have different labels or names.
-
-
-
-
-
-
-
-
-