Invention Grant
- Patent Title: Accelerated TR-L-BFGS algorithm for neural network
-
Application No.: US14823167Application Date: 2015-08-11
-
Publication No.: US10467528B2Publication Date: 2019-11-05
- Inventor: Dmitry Golovashkin , Uladzislau Sharanhovich , Vaishnavi Sashikanth
- Applicant: Oracle International Corporation
- Applicant Address: US CA Redwood Shores
- Assignee: Oracle International Corporation
- Current Assignee: Oracle International Corporation
- Current Assignee Address: US CA Redwood Shores
- Agency: Hickman Palermo Becker Bingham LLP
- Main IPC: G06N7/02
- IPC: G06N7/02 ; G06N7/04 ; G06N7/06 ; G06N7/08 ; G06N3/08

Abstract:
Techniques herein train a multilayer perceptron, sparsify edges of a graph such as the perceptron, and store edges and vertices of the graph. Each edge has weight. A computer sparsifies perceptron edges. The computer performs a forward-backward pass on the perceptron to calculate a sparse Hessian matrix. Based on that Hessian, the computer performs quasi-Newton perceptron optimization. The computer repeats this until convergence. The computer stores edges in an array and vertices in another array. Each edge has weight and input and output indices. Each vertex has input and output indices. The computer inserts each edge into an input linked list based on its weight. Each link of the input linked list has the next input index of an edge. The computer inserts each edge into an output linked list based on its weight. Each link of the output linked list comprises the next output index of an edge.
Public/Granted literature
- US20170046614A1 ACCELERATED TR-L-BFGS ALGORITHM FOR NEURAL NETWORK Public/Granted day:2017-02-16
Information query