- Patent Title: Foveated beamforming for augmented reality devices and wearables
-
Application No.: US17446877Application Date: 2021-09-03
-
Publication No.: US11967335B2Publication Date: 2024-04-23
- Inventor: Ruofei Du , Hendrik Wagenaar , Alex Olwal
- Applicant: Google LLC
- Applicant Address: US CA Mountain View
- Assignee: Google LLC
- Current Assignee: Google LLC
- Current Assignee Address: US CA Mountain View
- Agency: Brake Hughes Bellermann LLP
- Main IPC: G06F3/01
- IPC: G06F3/01 ; G06T7/50 ; G06T7/70 ; G06V40/16 ; G06V40/19 ; G10L15/22 ; G10L15/25 ; G10L15/26 ; G10L21/10 ; G10L21/18 ; H04R1/08 ; H04R1/40 ; H04R3/00

Abstract:
An augmented reality (AR) device, such as AR glasses, may include a microphone array. The sensitivity of the microphone array can be directed to a target by beamforming, which includes combining the audio of each microphone of the array in a particular way based on a location of the target. The present disclosure describes systems and methods to determine the location of the target based on a gaze of a user and beamform the audio accordingly. This eye-tracked beamforming (i.e., foveated beamforming) can be used by AR applications to enhance sounds from a gaze direction and to suppress sounds from other directions. Additionally, the gaze information can be used to help visualize the results of an AR application, such as speech-to-text.
Public/Granted literature
- US20230071778A1 FOVEATED BEAMFORMING FOR AUGMENTED REALITY DEVICES AND WEARABLES Public/Granted day:2023-03-09
Information query