Invention Grant
- Patent Title: Natural language processing using a neural network
-
Application No.: US16000638Application Date: 2018-06-05
-
Publication No.: US10699060B2Publication Date: 2020-06-30
- Inventor: Bryan McCann , Caiming Xiong , Richard Socher
- Applicant: salesforce.com, inc.
- Applicant Address: US CA San Francisco
- Assignee: salesforce.com, inc.
- Current Assignee: salesforce.com, inc.
- Current Assignee Address: US CA San Francisco
- Agency: Haynes and Boone, LLP
- Main IPC: G06F40/126
- IPC: G06F40/126 ; G06N3/08 ; G06N3/04 ; G06F40/30 ; G06F40/47 ; G06F40/205 ; G06F40/289 ; G06F40/44 ; G06F40/58

Abstract:
A system includes a neural network for performing a first natural language processing task. The neural network includes a first rectifier linear unit capable of executing an activation function on a first input related to a first word sequence, and a second rectifier linear unit capable of executing an activation function on a second input related to a second word sequence. A first encoder is capable of receiving the result from the first rectifier linear unit and generating a first task specific representation relating to the first word sequence, and a second encoder is capable of receiving the result from the second rectifier linear unit and generating a second task specific representation relating to the second word sequence. A biattention mechanism is capable of computing, based on the first and second task specific representations, an interdependent representation related to the first and second word sequences. In some embodiments, the first natural processing task performed by the neural network is one of sentiment classification and entailment classification.
Public/Granted literature
- US20180349359A1 NATURAL LANGUAGE PROCESSING USING A NEURAL NETWORK Public/Granted day:2018-12-06
Information query