Invention Grant
- Patent Title: Hierarchical self-attention for machine comprehension
-
Application No.: US16916697Application Date: 2020-06-30
-
Publication No.: US11721335B2Publication Date: 2023-08-08
- Inventor: Tao Li , Sheikh Sadid Al Hasan , Vivek Varma Datla , Oladimeji Feyisetan Farri
- Applicant: KONINKLIJKE PHILIPS N.V.
- Applicant Address: NL Eindhoven
- Assignee: Koninklijke Philips N.V.
- Current Assignee: Koninklijke Philips N.V.
- Current Assignee Address: NL Eindhoven
- Main IPC: G10L15/00
- IPC: G10L15/00 ; G10L15/22 ; G10L15/18 ; G06F40/216 ; G06N3/02 ; G06F17/16 ; G06F3/16

Abstract:
A method for determining the answer to a query in a document, including: encoding, by an encoder, the query and the document; generating a query-aware context encodings G by a bidirectional attention system using the encoded query and the encoded document; performing a hierarchical self-attention on the query aware document by a hierarchical self-attention system by applying a word to word attention and a word to sentence attention mechanism resulting in a matrix M; and determining the starting word and the ending word of the answer in the document by a span detector based upon the matrix M.
Public/Granted literature
- US20210005195A1 HIERARCHICAL SELF-ATTENTION FOR MACHINE COMPREHENSION Public/Granted day:2021-01-07
Information query