Invention Grant
- Patent Title: End-to-end memory networks
-
Application No.: US15472086Application Date: 2017-03-28
-
Publication No.: US10664744B2Publication Date: 2020-05-26
- Inventor: Jason E. Weston , Arthur David Szlam , Robert D. Fergus , Sainbayar Sukhbaatar
- Applicant: Facebook, Inc.
- Applicant Address: US CA Menlo Park
- Assignee: Facebook, Inc.
- Current Assignee: Facebook, Inc.
- Current Assignee Address: US CA Menlo Park
- Agency: Baker Botts L.L.P.
- Main IPC: G06N3/04
- IPC: G06N3/04 ; G06N3/08 ; G06F16/9032 ; G06F40/279

Abstract:
Embodiments are disclosed for predicting a response (e.g., an answer responding to a question) using an end-to-end memory network model. A computing device according to some embodiments includes embedding matrices to convert knowledge entries and an inquiry into feature vectors including the input vector and memory vectors. The device further execute a hop operation to generate a probability vector based on an input vector and a first set of memory vectors using a continuous weighting function (e.g., softmax), and to generate an output vector as weighted combination of a second set of memory vectors using the elements of the probability vector as weights. The device can repeat the hop operation for multiple times, where the input vector for a hop operation depends on input and output vectors of previous hop operation(s). The device generates a predicted response based on at least the output of the last hop operation.
Public/Granted literature
- US20170200077A1 END-TO-END MEMORY NETWORKS Public/Granted day:2017-07-13
Information query