Invention Grant
- Patent Title: Technologies for scaling deep learning training
-
Application No.: US15476998Application Date: 2017-04-01
-
Publication No.: US11068780B2Publication Date: 2021-07-20
- Inventor: Naveen K. Mellempudi , Srinivas Sridharan , Dheevatsa Mudigere , Dipankar Das
- Applicant: Intel Corporation
- Applicant Address: US CA Santa Clara
- Assignee: Intel Corporation
- Current Assignee: Intel Corporation
- Current Assignee Address: US CA Santa Clara
- Agency: Hanley, Flight & Zimmerman, LLC
- Main IPC: G06N3/08
- IPC: G06N3/08 ; G06N3/06 ; G06N3/04 ; G06N3/063

Abstract:
Technologies for artificial neural network training include a computing node with a host fabric interface that sends a message that includes one or more artificial neural network training algorithm values to another computing node in response to receipt of a request to send the message. Prior to sending the message, the host fabric interface may receive a request to quantize the message and quantize the message based on a quantization level included in the request to generate a quantized message. The quantization message includes one or more quantized values such that each quantized value has a lower precision than a corresponding artificial neural network training algorithm value. The host fabric interface then transmits the quantized message, which includes metadata indicative of the quantization level, to another computing node in response to quantization of the message for artificial neural network training. Other embodiments are described and claimed.
Public/Granted literature
- US20180285733A1 TECHNOLOGIES FOR SCALING MULTILAYERED ARTIFICIAL NEURAL NETWORK TRAINING ALGORITHMS Public/Granted day:2018-10-04
Information query