公开(公告)号：US20180047395A1

公开(公告)日：2018-02-15

申请号：US15673894

申请日：2017-08-10

Applicant: Magic Leap, Inc.

Inventor： Jeffrey Sommers ,  Jennifer M.R. Devine ,  Joseph Wayne Seuck ,  Adrian Kaehler

IPC: G10L15/26 ,  G06F17/24 ,  H04N7/15 ,  G10L15/18 ,  G06F17/28 ,  G10L25/84 ,  G06K9/00

CPC classification number: G10L15/265 ,  G06F17/241 ,  G06F17/2735 ,  G06F17/289 ,  G06K9/00671 ,  G10L15/1815 ,  G10L15/26 ,  G10L25/84 ,  G10L2015/088 ,  H04N7/142 ,  H04N7/157

Abstract: An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.

公开(公告)号：US20220309722A1

公开(公告)日：2022-09-29

申请号：US17831217

申请日：2022-06-02

Applicant: Magic Leap, Inc.

Inventor： Paul Armistead Hoover ,  Sam Baker ,  Jennifer M.R. Devine

IPC: G06T11/60 ,  G06T19/00 ,  G06F3/01 ,  G02B27/01 ,  G06F3/00 ,  G06F3/04812 ,  G06F3/04815 ,  G06V20/20 ,  G06V40/18

Abstract: Systems and methods for displaying a virtual reticle in an augmented or virtual reality environment by a wearable device are described. The environment can include real or virtual objects that may be interacted with by the user through a variety of poses, such as, e.g., head pose, eye pose or gaze, or body pose. The user may select objects by pointing the virtual reticle toward a target object by changing pose or gaze. The wearable device can recognize that an orientation of a user's head or eyes is outside of a range of acceptable or comfortable head or eye poses and accelerate the movement of the reticle away from a default position and toward a position in the direction of the user's head or eye movement, which can reduce the amount of movement by the user to align the reticle and target.

公开(公告)号：US20220327281A1

公开(公告)日：2022-10-13

申请号：US17850860

申请日：2022-06-27

Applicant: Magic Leap, Inc.

Inventor： Jeffrey Scott Sommers ,  Jennifer M.R. Devine ,  Joseph Wayne Seuck ,  Adrian Kaehler

IPC: G06F40/169 ,  G06F40/242 ,  H04N7/15 ,  G06F40/58 ,  G10L15/18 ,  G10L25/84 ,  G10L15/26 ,  G06V20/20 ,  G10L15/08 ,  H04N7/14

Abstract: An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.

公开(公告)号：US20200184975A1

公开(公告)日：2020-06-11

申请号：US16791855

申请日：2020-02-14

Applicant: Magic Leap, Inc.

Inventor： Jeffrey Scott Sommers ,  Jennifer M.R. Devine ,  Joseph Wayne Seuck ,  Adrian Kaehler

IPC: G10L15/26 ,  H04N7/15 ,  G10L25/84 ,  G10L15/18 ,  G06K9/00 ,  G06F40/242 ,  G06F40/169 ,  G06F40/58

Abstract: An augmented reality (AR) device can be configured to monitor ambient audio data. The AR device can detect speech in the ambient audio data, convert the detected speech into text, or detect keywords such as rare words in the speech. When a rare word is detected, the AR device can retrieve auxiliary information (e.g., a definition) related to the rare word from a public or private source. The AR device can display the auxiliary information for a user to help the user better understand the speech. The AR device may perform translation of foreign speech, may display text (or the translation) of a speaker's speech to the user, or display statistical or other information associated with the speech.

公开(公告)号：US20240386643A1

公开(公告)日：2024-11-21

申请号：US18787935

申请日：2024-07-29

Applicant: Magic Leap, Inc.

Inventor： Paul Armistead Hoover ,  Sam Baker ,  Jennifer M.R. Devine

IPC: G06T11/60 ,  G02B27/01 ,  G06F3/00 ,  G06F3/01 ,  G06F3/04812 ,  G06F3/04815 ,  G06T19/00 ,  G06V20/20 ,  G06V40/18

Abstract: Systems and methods for displaying a virtual reticle in an augmented or virtual reality environment by a wearable device are described. The environment can include real or virtual objects that may be interacted with by the user through a variety of poses, such as, e.g., head pose, eye pose or gaze, or body pose. The user may select objects by pointing the virtual reticle toward a target object by changing pose or gaze. The wearable device can recognize that an orientation of a user's head or eyes is outside of a range of acceptable or comfortable head or eye poses and accelerate the movement of the reticle away from a default position and toward a position in the direction of the user's head or eye movement, which can reduce the amount of movement by the user to align the reticle and target.

公开(公告)号：US20240211028A1

公开(公告)日：2024-06-27

申请号：US18596054

申请日：2024-03-05

Applicant: Magic Leap, Inc.

Inventor： James M. Powderly ,  Savannah Niles ,  Jennifer M.R. Devine ,  Adam C. Carlson ,  Jeffrey Scott Sommers ,  Praveen Babu J D ,  Ajoy Savio Fernandes ,  Anthony Robert Sheeder

IPC: G06F3/01 ,  G02B27/01 ,  G06F1/16 ,  G06F3/16 ,  G06T19/00

CPC classification number: G06F3/011 ,  G02B6/0076 ,  G02B27/0172 ,  G02B27/0179 ,  G06F1/163 ,  G06F3/013 ,  G06F3/017 ,  G06F3/167 ,  G06T19/003 ,  G06T19/006 ,  G02B2027/0127 ,  G02B2027/0138 ,  G02B2027/014 ,  G02B2027/0187 ,  G06F2203/0381

Abstract: Examples of wearable systems and methods can use multiple inputs (e.g., gesture, head pose, eye gaze, voice, and/or environmental factors (e.g., location)) to determine a command that should be executed and objects in the three-dimensional (3D) environment that should be operated on. The multiple inputs can also be used by the wearable system to permit a user to interact with text, such as, e.g., composing, selecting, or editing text.

公开(公告)号：US20220171453A1

公开(公告)日：2022-06-02

申请号：US17645714

申请日：2021-12-22

Applicant: Magic Leap, Inc.

Inventor： James M. Powderly ,  Savannah Niles ,  Jennifer M.R. Devine ,  Adam C. Carlson ,  Jeffrey Scott Sommers ,  Praveen Babu J D ,  Ajoy Savio Fernandes ,  Anthony Robert Sheeder

IPC: G06F3/01 ,  G06F1/16 ,  G06T19/00 ,  F21V8/00 ,  G02B27/01

Abstract: Examples of wearable systems and methods can use multiple inputs (e.g., gesture, head pose, eye gaze, voice, and/or environmental factors (e.g., location)) to determine a command that should be executed and objects in the three-dimensional (3D) environment that should be operated on. The multiple inputs can also be used by the wearable system to permit a user to interact with text, such as, e.g., composing, selecting, or editing text.

公开(公告)号：US20210090311A1

公开(公告)日：2021-03-25

申请号：US17063077

申请日：2020-10-05

Applicant: Magic Leap, Inc.

Inventor： Paul Armistead Hoover ,  Sam Baker ,  Jennifer M.R. Devine

IPC: G06T11/60 ,  G06T19/00 ,  G06F3/01 ,  G02B27/01 ,  G06F3/00 ,  G06K9/00 ,  G06F3/0481

Abstract: Systems and methods for displaying a virtual reticle in an augmented or virtual reality environment by a wearable device are described. The environment can include real or virtual objects that may be interacted with by the user through a variety of poses, such as, e.g., head pose, eye pose or gaze, or body pose. The user may select objects by pointing the virtual reticle toward a target object by changing pose or gaze. The wearable device can recognize that an orientation of a user's head or eyes is outside of a range of acceptable or comfortable head or eye poses and accelerate the movement of the reticle away from a default position and toward a position in the direction of the user's head or eye movement, which can reduce the amount of movement by the user to align the reticle and target.

公开(公告)号：US20190130622A1

公开(公告)日：2019-05-02

申请号：US16170407

申请日：2018-10-25

Applicant: Magic Leap, Inc.

Inventor： Paul Armistead Hoover ,  Sam Baker ,  Jennifer M.R. Devine

IPC: G06T11/60 ,  G06F3/01 ,  G06T19/00

Abstract: Systems and methods for displaying a virtual reticle in an augmented or virtual reality environment by a wearable device are described. The environment can include real or virtual objects that may be interacted with by the user through a variety of poses, such as, e.g., head pose, eye pose or gaze, or body pose. The user may select objects by pointing the virtual reticle toward a target object by changing pose or gaze. The wearable device can recognize that an orientation of a user's head or eyes is outside of a range of acceptable or comfortable head or eye poses and accelerate the movement of the reticle away from a default position and toward a position in the direction of the user's head or eye movement, which can reduce the amount of movement by the user to align the reticle and target.