Invention Grant
- Patent Title: Apparatus and method for executing reversal training of artificial neural network
-
Application No.: US16441019Application Date: 2019-06-14
-
Publication No.: US10713568B2Publication Date: 2020-07-14
- Inventor: Shaoli Liu , Qi Guo , Yunji Chen , Tianshi Chen
- Applicant: CAMBRICON TECHNOLOGIES CORPORATION LIMITED
- Applicant Address: CN Beijing
- Assignee: CAMBRICON TECHNOLOGIES CORPORATION LIMITED
- Current Assignee: CAMBRICON TECHNOLOGIES CORPORATION LIMITED
- Current Assignee Address: CN Beijing
- Agency: Getech Law LLC
- Agent Jun Ye
- Main IPC: G06N3/08
- IPC: G06N3/08 ; G06N3/063 ; G06N3/04 ; G06F9/30 ; G06F9/38 ; G06F15/173 ; G06N5/00 ; G06F13/28 ; G06F9/22

Abstract:
An apparatus for executing backpropagation of an artificial neural network comprises an instruction caching unit, a controller unit, a direct memory access unit, an interconnection unit, a master computation module, and multiple slave computation modules. For each layer in a multilayer neural network, weighted summation may be performed on input gradient vectors to calculate an output gradient vector of this layer. The output gradient vector may be multiplied by a derivative value of a next-layer activation function on which forward operation is performed, so that a next-layer input gradient vector can be obtained. The input gradient vector may be multiplied by an input neuron counterpoint in forward operation to obtain the gradient of a weight value of this layer, and the weight value of this layer can be updated according to the gradient of the obtained weight value of this layer.
Public/Granted literature
- US20190294971A1 APPARATUS AND METHOD FOR EXECUTING REVERSAL TRAINING OF ARTIFICIAL NEURAL NETWORK Public/Granted day:2019-09-26
Information query