Invention Grant
- Patent Title: Numerical representation for neural networks
-
Application No.: US17262717Application Date: 2019-07-17
-
Publication No.: US11062202B2Publication Date: 2021-07-13
- Inventor: Michael Edwin James , Sean Lie , Michael Morrison , Srikanth Arekapudi , Gary R. Lauterbach
- Applicant: Cerebras Systems Inc.
- Applicant Address: US CA Los Altos
- Assignee: Cerebras Systems Inc.
- Current Assignee: Cerebras Systems Inc.
- Current Assignee Address: US CA Los Altos
- Agency: PatentVentures
- Agent Bennett Smith; Korbin Van Dyke
- International Application: PCT/IB2019/056118 WO 20190717
- International Announcement: WO2020/021395 WO 20200130
- Main IPC: G06N3/063
- IPC: G06N3/063 ; G06F7/483 ; G06N3/08

Abstract:
Techniques in advanced deep learning provide improvements in one or more of accuracy, performance, and energy efficiency. An array of processing elements comprising a portion of a neural network accelerator performs flow-based computations on wavelets of data. Each processing element has a respective compute element and a respective routing element. Each compute element has a respective floating-point unit enabled to optionally and/or selectively perform floating-point operations in accordance with a programmable exponent bias and/or various floating-point computation variations. In some circumstances, the programmable exponent bias and/or the floating-point computation variations enable neural network processing with improved accuracy, decreased training time, decreased inference latency, and/or increased energy efficiency.
Public/Granted literature
- US20210142155A1 NUMERICAL REPRESENTATION FOR NEURAL NETWORKS Public/Granted day:2021-05-13
Information query