Invention Grant
- Patent Title: End-to-end deep neural network for auditory attention decoding
-
Application No.: US16720810Application Date: 2019-12-19
-
Publication No.: US11630513B2Publication Date: 2023-04-18
- Inventor: Gregory Ciccarelli , Christopher Smalt , Thomas Quatieri , Michael Brandstein , Paul Calamia , Stephanie Haro , Michael Nolan , Joseph Perricone , Nima Mesgarani , James O'Sullivan
- Applicant: Massachusetts Institute of Technology , The Trustees of Columbia University in the City of New York
- Applicant Address: US MA Cambridge; US NY New York
- Assignee: Massachusetts Institute of Technology,The Trustees of Columbia University in the City of New York
- Current Assignee: Massachusetts Institute of Technology,The Trustees of Columbia University in the City of New York
- Current Assignee Address: US MA Cambridge; US NY New York
- Agency: Daly, Crowley, Mofford & Durkee, LLP
- Main IPC: G06F3/01
- IPC: G06F3/01 ; G06K9/62 ; G06K9/00 ; G06N3/04 ; G06N3/08 ; G10L21/0208 ; G10L21/0272 ; A61B5/12 ; A61B5/31 ; A61B5/369 ; H04R1/10 ; H04R25/00 ; G06N3/02 ; G06F18/22 ; G06F18/25

Abstract:
In one aspect of the present disclosure, method includes: receiving neural data responsive to a listener's auditory attention; receiving an acoustic signal responsive to a plurality of acoustic sources; for each of the plurality of acoustic sources: generating, from the received acoustic signal, audio data comprising one or more features of the acoustic source, forming combined data representative of the neural data and the audio data, and providing the combined data to a classification network configured to calculate a similarity score between the neural data and the acoustic source using one or more similarity metrics; and using the similarity scores calculated for each of the acoustic sources to identify, from the plurality of acoustic sources, an acoustic source associated with the listener's auditory attention.
Information query