-
公开(公告)号:US12260015B2
公开(公告)日:2025-03-25
申请号:US18382737
申请日:2023-10-23
Applicant: Snap Inc.
Inventor: Ilteris Canberk , Shin Hwun Kang , Doug Mead
IPC: G06F3/01 , G06F18/22 , G06T7/73 , H04B1/3827 , H04W4/029
Abstract: Systems, devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device. A portable eyewear device includes a processor, a memory, and a display projected onto at least one lens assembly. The memory has programming stored therein that, when executed by the processor, captures information depicting an environment surrounding the device and identifies a match between objects in that information and predetermined objects in previously obtained information for the same environment. When the position of the eyewear device reaches a preselected location with respect to the matched objects, a physical output is provided to produce the immersive experience. The physical output changes as the position of the eyewear device moves to maintain the immersive experience.
-
公开(公告)号:US12249036B2
公开(公告)日:2025-03-11
申请号:US18391879
申请日:2023-12-21
Applicant: Snap Inc.
Inventor: Ilteris Canberk , Shin Hwun Kang , Dmytro Kucher
IPC: G06T19/00 , G02B27/01 , G06T7/73 , G06V40/10 , G10L15/26 , H04N13/111 , H04N13/207 , H04N13/332
Abstract: Eyewear presenting text corresponding to spoken words (e.g., in speech bubbles) and optionally translating from one language to another. In one example, an interactive augmented reality experience is provided between two users of eyewear devices to allow one user of an eyewear device to share a personal attribute of the user with a second user. The personal attribute can be speech spoken by a remote second user of eyewear converted to text. The converted text can be displayed on a display of eyewear of the first user proximate the viewed second user. The personal attribute may be displayed in a speech bubble proximate the second user, such as proximate the head or mouth of the second user. The language of the spoken speech can be recognized by the second user eyewear, and translated to a language that is understood by the first user. In another example, the spoken words of a remote person is captured by the eyewear of a user, the position of the remote person is identified, the spoken word are converted to text, and the text is displayed (e.g., in a speech bubble) on an AR display of the eyewear adjacent the remote person.
-
公开(公告)号:US12236535B2
公开(公告)日:2025-02-25
申请号:US18510286
申请日:2023-11-15
Applicant: Snap Inc.
Inventor: Shin Hwun Kang , Dmytro Kucher , Dmytro Hovorov , Ilteris Canberk
Abstract: Augmented reality guidance for guiding a user through an environment using an eyewear device. The eyewear device includes a display system and a position detection system. A user is guided though an environment by monitoring a current position of the eyewear device within the environment, identifying marker positions within a threshold of the current position, the marker positions defined with respect to the environment and associated with guidance markers, registering the marker positions, generating overlay image including the guidance markers, and presenting the overlay image on a display of the eyewear device.
-
公开(公告)号:US20240393887A1
公开(公告)日:2024-11-28
申请号:US18797805
申请日:2024-08-08
Applicant: Snap Inc.
Inventor: Ilteris Canberk , Viktoria Hwang , Shin Hwun Kang , David Meisenholder , Daniel Moreno
IPC: G06F3/01 , G02B27/01 , G06F3/04815 , G06F3/04847 , G06T19/00 , G06V20/40 , G06V40/10 , G06V40/20
Abstract: Example systems, devices, media, and methods are described for controlling virtual elements or graphical elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a series of hand shapes in the video data and determines whether it matches a predefined series of hand gestures. Each predefined series of hand gestures is associated with an action. The system controls movement of the virtual element, relative to the display, in accordance with the associated action. In an example hand shape that includes a thumb sliding along an extended finger, the system establishes a finger scale along the extended finger, calibrates a graphical scale with the finger scale, and controls movement of an interactive graphical element, such as a slider, according to the current thumb position relative to the calibrated graphical scale.
-
公开(公告)号:US12039649B2
公开(公告)日:2024-07-16
申请号:US18306776
申请日:2023-04-25
Applicant: Snap Inc.
Inventor: Ilteris Canberk , Andrés Monroy-Hernández , Rajan Vaish
CPC classification number: G06T11/60 , G06T11/001 , G06T19/006 , G06T2200/24
Abstract: A server machine modifies an augmented reality (AR) object in response to fulfillment of a condition. The machine provides, to a user device, object data that defines the AR object. The object data specifies a physical geolocation of the AR object, a presentation attribute of the AR object, a conditional modification program, and a trigger condition for execution of the conditional modification program. The object data causes the user device to present the AR object with a first appearance, located at the physical geolocation. The machine detects fulfillment of the trigger condition, and in response, the machine executes the conditional modification program. This modifies the object data by modifying the presentation attribute. The machine provides, to the user device, the modified object data, which causes the user device to present the AR object with a second appearance based on the modified presentation attribute.
-
公开(公告)号:US12013985B1
公开(公告)日:2024-06-18
申请号:US17588934
申请日:2022-01-31
Applicant: Snap Inc.
Inventor: Karen Stolzenberg , Ilteris Canberk
IPC: G06F3/04815 , G02B27/01 , G06F3/01 , G06F3/0485 , G06T19/00 , G06V20/40 , G06V40/10 , G06V40/20
CPC classification number: G06F3/017 , G02B27/0101 , G02B27/017 , G06F3/011 , G06F3/04815 , G06F3/0485 , G06T19/006 , G06V20/46 , G06V40/113 , G06V40/28 , G02B2027/0138 , G02B2027/0178
Abstract: Example systems, devices, media, and methods are described for controlling the presentation of a series of virtual or graphical elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a series of hand shapes in the video data and determines whether it matches a predefined hand gesture. Each predefined hand gesture is associated with an action; for example, a leafing gesture is associated with a scrolling action. The system controls the display of a series of virtual elements, in accordance with the associated action. In an example series of hand shapes that includes flexing and extending the fingers of a single hand severally and continually in a leafing motion, the matching predefined leafing gesture is associated with a scrolling action, which displays the series of items in a display order, sequentially and in accordance with the detected speed of the moving fingers.
-
公开(公告)号:US20240087237A1
公开(公告)日:2024-03-14
申请号:US18510286
申请日:2023-11-15
Applicant: Snap Inc.
Inventor: Shin Hwun Kang , Dmytro Kucher , Dmytro Hovorov , Ilteris Canberk
CPC classification number: G06T19/003 , G02B27/0172 , G02B27/0176 , G06T7/73 , G02B2027/0138 , G02B2027/014 , G06T2207/30204
Abstract: Augmented reality guidance for guiding a user through an environment using an eyewear device. The eyewear device includes a display system and a position detection system. A user is guided though an environment by monitoring a current position of the eyewear device within the environment, identifying marker positions within a threshold of the current position, the marker positions defined with respect to the environment and associated with guidance markers, registering the marker positions, generating overlay image including the guidance markers, and presenting the overlay image on a display of the eyewear device.
-
公开(公告)号:US20230393402A1
公开(公告)日:2023-12-07
申请号:US18234989
申请日:2023-08-17
Applicant: Snap Inc.
Inventor: Robert Matthew Bates , Ilteris Canberk , Brandon Carrillo , David G. Fliszar , Adam Douglas Greengard , Kenneth Kubala , David Meisenholder , Jonathan M. Rodriguez, II , Amit Singh , Samuel Thompson
IPC: G02B27/01 , H04B1/3827 , G06T11/60 , G09G3/32
CPC classification number: G02B27/0172 , G02B27/0179 , G02B27/0176 , H04B1/385 , G06T11/60 , G09G3/32 , G09G2330/021 , G02B2027/0187 , G02B2027/0112 , G02B2027/0138 , G02B2027/014 , G09G2354/00 , G02B2027/0178
Abstract: The present application discloses examples of various apparatuses and systems that can be utilized for augmented reality. According to one example, a wearable device that can optionally comprise: a frame configured for wearing by a user; one or more optical elements mounted on the frame; an array having a plurality of light emitting diodes coupled to the one or more optical elements, wherein the one or more optical elements and the array are mounted within a field of view of the user when the frame is worn by the user; and additional onboard electronic components carried by the frame including at least a battery that is configured to provide for electrically powered operation of the array.
-
公开(公告)号:US20230367118A1
公开(公告)日:2023-11-16
申请号:US18223308
申请日:2023-07-18
Applicant: Snap Inc.
Inventor: Ilteris Canberk , Jacob Knipfing
CPC classification number: G02B27/0093 , G02B27/0172 , G06F3/013 , G02B2027/0187 , G02B2027/0138 , G02B2027/0178
Abstract: Interactive augmented reality experiences with an eyewear device including a virtual eyewear beam. The user can direct the virtual beam by orienting the eyewear device or the user's eye gaze or both. The eyewear device may detect the direction of an opponent's eyewear device or eye gaze of both. The eyewear device may calculate a score based on hits of the virtual beam of the user and the opponent on respective target areas such as the other player's head or face.
-
公开(公告)号:US11774760B2
公开(公告)日:2023-10-03
申请号:US17718783
申请日:2022-04-12
Applicant: Snap Inc.
Inventor: Robert Matthew Bates , Ilteris Canberk , Brandon Carrillo , David G. Fliszar , Adam Douglas Greengard , Kenneth Kubala , David Meisenholder , Jonathan M Rodriguez, II , Amit Singh , Samuel Thompson
IPC: G02B27/01 , H04B1/3827 , G06T11/60 , G09G3/32
CPC classification number: G02B27/0172 , G02B27/0176 , G02B27/0179 , G06T11/60 , G09G3/32 , H04B1/385 , G02B2027/014 , G02B2027/0112 , G02B2027/0138 , G02B2027/0178 , G02B2027/0187 , G09G2330/021 , G09G2354/00
Abstract: The present application discloses examples of various apparatuses and systems that can be utilized for augmented reality. According to one example, a wearable device that can optionally comprise: a frame configured for wearing by a user; one or more optical elements mounted on the frame; an array having a plurality of light emitting diodes coupled to the one or more optical elements, wherein the one or more optical elements and the array are mounted within a field of view of the user when the frame is worn by the user; and additional onboard electronic components carried by the frame including at least a battery that is configured to provide for electrically powered operation of the array.
-
-
-
-
-
-
-
-
-