Invention Grant
- Patent Title: Processing discontiguous memory as contiguous memory to improve performance of a neural network environment
-
Application No.: US15829832Application Date: 2017-12-01
-
Publication No.: US10963403B2Publication Date: 2021-03-30
- Inventor: George Petre , Chad Balling McBride , Amol Ashok Ambardekar , Kent D. Cedola , Boris Bobrov , Larry Marvin Wall
- Applicant: Microsoft Technology Licensing, LLC
- Applicant Address: US WA Redmond
- Assignee: Microsoft Technology Licensing, LLC
- Current Assignee: Microsoft Technology Licensing, LLC
- Current Assignee Address: US WA Redmond
- Agency: Newport IP, LLC
- Agent Han Gim
- Main IPC: G06N3/063
- IPC: G06N3/063 ; G06N3/02 ; G06F13/16 ; G06N3/04 ; G06F12/0862 ; G06F9/46 ; G06F1/324 ; G06F3/06 ; G06F9/38 ; G06F12/08 ; G06F12/10 ; G06F15/80 ; G06F17/15 ; G06N3/06 ; G06N3/08 ; G06N3/10 ; H03M7/30 ; H04L12/715 ; H04L29/08 ; G06F1/3234 ; G06F12/02 ; G06F13/28 ; H03M7/46 ; H04L12/723

Abstract:
The performance of a neural network (NN) can be limited by the number of operations being performed. Using a line buffer that is directed to shift a memory block by a selected shift stride for cooperating neurons, data that is operatively residing memory and which would require multiple write cycles into a cooperating line buffer can be processed as in a single line buffer write cycle thereby enhancing the performance of a NN/DNN. A controller and/or iterator can generate one or more instructions having the memory block shifting values for communication to the line buffer. The shifting values can be calculated using various characteristics of the input data as well as the NN/DNN inclusive of the data dimensions. The line buffer can read data for processing, shift the data of the memory block and write the data in the line buffer for subsequent processing.
Public/Granted literature
Information query