公开(公告)号：US20230267900A1

公开(公告)日：2023-08-24

申请号：US18142181

申请日：2023-05-02

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Donald Giovannini ,  Sana Park

IPC: G10H1/00 ,  G06T7/90

CPC classification number: G10H1/0025 ,  G06T7/90 ,  G10H1/0041 ,  G10H2220/101 ,  G06T2207/10024 ,  G10H2220/445 ,  G10H2220/455 ,  G06T2207/30204

Abstract: Systems, devices, media, and methods are presented for playing audio sounds, such as music, on a portable electronic device using a digital color image of a note matrix on a map. A computer vision engine, in an example implementation, includes a mapping module, a color detection module, and a music playback module. The camera captures a color image of the map, including a marker and a note matrix. Based on the color image, the computer vision engine detects a token color value associated with each field. Each token color value is associated with a sound sample from a specific musical instrument. A global state map is stored in memory, including the token color value and location of each field in the note matrix. The music playback module, for each column, in order, plays the notes associated with one or more the rows, using the corresponding sound sample, according to the global state map.

公开(公告)号：US20210405363A1

公开(公告)日：2021-12-30

申请号：US17359969

申请日：2021-06-28

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang

IPC: G02B27/01 ,  G02B27/00 ,  G08B3/10 ,  G06T19/00

Abstract: Augmented reality experiences with an eyewear device including a position detection system and a display system are provided. The eyewear device allows setting a predefined distance target or distance targets. The eyewear device monitors the distance between the eyewear device and one or more other persons using the position detection system of the eyewear device. The eyewear device generates an alert if one or more of the other persons is within the one or more predefined distance targets.

公开(公告)号：US12256211B2

公开(公告)日：2025-03-18

申请号：US18198055

申请日：2023-05-16

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang ,  James Powderly

IPC: H04S7/00 ,  G02B27/01 ,  G06T19/00 ,  H04W4/029

Abstract: Systems, devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device with spatial audio. The eyewear device has a processor, a memory, an image sensor, and speakers. The eyewear device captures image information for an environment surrounding the device, identifies a match between objects in the image information and predetermined objects in previously obtained information for the same environment. The eyewear device then identifies a target location within the environment, which may be associated with a physical or a virtual object. The eyewear device monitors its orientation with respect to the target location and presents audio signals to guide the user toward the target location.

公开(公告)号：US12196954B2

公开(公告)日：2025-01-14

申请号：US18223308

申请日：2023-07-18

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Jacob Knipfing

IPC: G02B27/00 ,  G02B27/01 ,  G06F3/01

Abstract: Interactive augmented reality experiences with an eyewear device including a virtual eyewear beam. The user can direct the virtual beam by orienting the eyewear device or the user's eye gaze or both. The eyewear device may detect the direction of an opponent's eyewear device or eye gaze of both. The eyewear device may calculate a score based on hits of the virtual beam of the user and the opponent on respective target areas such as the other player's head or face.

公开(公告)号：US12192740B2

公开(公告)日：2025-01-07

申请号：US18532679

申请日：2023-12-07

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang

IPC: H04S7/00 ,  G02B27/01

Abstract: Devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device with spatial audio. The eyewear device has a processor, a memory, an image sensor, and a speaker system. The eyewear device captures image information for an environment surrounding the device and identifies an object location within the same environment. The eyewear device then associates a virtual object with the identified object location. The eyewear device monitors the position of the device with respect to the virtual object and presents audio signals to alert the user that the identified object is in the environment.

公开(公告)号：US12086324B2

公开(公告)日：2024-09-10

申请号：US17550679

申请日：2021-12-14

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Viktoria Hwang ,  Shin Hwun Kang ,  David Meisenholder ,  Daniel Moreno

IPC: G06F3/04815 ,  G02B27/01 ,  G06F3/01 ,  G06F3/04847 ,  G06T19/00 ,  G06V20/40 ,  G06V40/10 ,  G06V40/20

CPC classification number: G06F3/017 ,  G02B27/0101 ,  G02B27/017 ,  G06F3/04815 ,  G06F3/04847 ,  G06T19/006 ,  G06V20/46 ,  G06V40/113 ,  G06V40/28 ,  G02B2027/0138 ,  G02B2027/0178

Abstract: Example systems, devices, media, and methods are described for controlling virtual elements or graphical elements on a display in response to hand gestures detected by an eyewear device that is capturing frames of video data with its camera system. An image processing system detects a series of hand shapes in the video data and determines whether it matches a predefined series of hand gestures. Each predefined series of hand gestures is associated with an action. The system controls movement of the virtual element, relative to the display, in accordance with the associated action. In an example hand shape that includes a thumb sliding along an extended finger, the system establishes a finger scale along the extended finger, calibrates a graphical scale with the finger scale, and controls movement of an interactive graphical element, such as a slider, according to the current thumb position relative to the calibrated graphical scale.

公开(公告)号：US12008153B2

公开(公告)日：2024-06-11

申请号：US17988526

申请日：2022-11-16

Applicant: Snap Inc.

Inventor： Shin Hwun Kang ,  Ilteris Canberk ,  James Powderly ,  Dmytro Kucher ,  Dmytro Hovorov

IPC: A63F13/46 ,  A63F13/577 ,  G02B27/01 ,  G06F3/01 ,  G06F3/16 ,  G06T7/73

CPC classification number: G06F3/011 ,  A63F13/46 ,  A63F13/577 ,  G02B27/0101 ,  G02B27/0172 ,  G02B27/0179 ,  G06F3/167 ,  G06T7/73 ,  A63F2300/8082 ,  G02B2027/0138 ,  G02B2027/0178 ,  G02B2027/0187 ,  G06T2207/30208

Abstract: Interactive augmented reality experiences with an eyewear device including a position detection system and a display system. The eyewear device registers a first marker position for a user-controlled virtual game piece and a second marker for an interaction virtual game piece. The eyewear device monitors its position (e.g., location and orientation) and updates the position of the user-controlled virtual game piece accordingly. The eyewear device additionally monitors the position of the user-controlled virtual game piece with respect to the interaction virtual game piece for use in generating a score. Augmented reality examples include a “spheroidal balancing” augmented reality experience and a “spheroidal balancing” augmented reality experience.

公开(公告)号：US11863963B2

公开(公告)日：2024-01-02

申请号：US17528713

申请日：2021-11-17

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Shin Hwun Kang

IPC: H04S7/00 ,  G02B27/01

CPC classification number: H04S7/303 ,  G02B27/017 ,  G02B2027/0138 ,  G02B2027/0178 ,  H04S2400/11

Abstract: Devices, media, and methods are presented for an immersive augmented reality (AR) experience using an eyewear device with spatial audio. The eyewear device has a processor, a memory, and image sensor, and a speaker system. The eyewear device captures image information for an environment surrounding the device and identifies an object location within the same environment. The eyewear device then associates a virtual object with the identified object location. The eyewear device monitors the position of the device with respect to the virtual object and presents audio signals to alert the user that the identified object is in the environment.

公开(公告)号：US11854147B2

公开(公告)日：2023-12-26

申请号：US17682296

申请日：2022-02-28

Applicant: Snap Inc.

Inventor： Shin Hwun Kang ,  Dmytro Kucher ,  Dmytro Hovorov ,  Ilteris Canberk

IPC: G06T19/00 ,  G06T7/73 ,  G02B27/01

CPC classification number: G06T19/003 ,  G02B27/0172 ,  G02B27/0176 ,  G06T7/73 ,  G02B2027/014 ,  G02B2027/0138 ,  G06T2207/30204

Abstract: Augmented reality guidance for guiding a user through an environment using an eyewear device. The eyewear device includes a display system and a position detection system. A user is guided though an environment by monitoring a current position of the eyewear device within the environment, identifying marker positions within a threshold of the current position, the marker positions defined with respect to the environment and associated with guidance markers, registering the marker positions, generating overlay image including the guidance markers, and presenting the overlay image on a display of the eyewear device.

公开(公告)号：US20230260178A1

公开(公告)日：2023-08-17

申请号：US18306776

申请日：2023-04-25

Applicant: Snap Inc.

Inventor： Ilteris Canberk ,  Andrès Monroy-Hernández ,  Rajan Vaish

IPC: G06T11/60 ,  G06T11/00 ,  G06T19/00

CPC classification number: G06T11/60 ,  G06T11/001 ,  G06T19/006 ,  G06T2200/24

Abstract: A server machine modifies an augmented reality (AR) object in response to fulfillment of a condition. The machine provides, to a user device, object data that defines the AR object. The object data specifies a physical geolocation of the AR object, a presentation attribute of the AR object, a conditional modification program, and a trigger condition for execution of the conditional modification program. The object data causes the user device to present the AR object with a first appearance, located at the physical geolocation. The machine detects fulfillment of the trigger condition, and in response, the machine executes the conditional modification program. This modifies the object data by modifying the presentation attribute. The machine provides, to the user device, the modified object data, which causes the user device to present the AR object with a second appearance based on the modified presentation attribute.