Invention Grant
- Patent Title: Methods and systems for selecting quantisation parameters for deep neural networks using back-propagation
-
Application No.: US16724650Application Date: 2019-12-23
-
Publication No.: US11610127B2Publication Date: 2023-03-21
- Inventor: Szabolcs Csefalvay
- Applicant: Imagination Technologies Limited
- Applicant Address: GB Kings Langley
- Assignee: Imagination Technologies Limited
- Current Assignee: Imagination Technologies Limited
- Current Assignee Address: GB Kings Langley
- Agency: Potomac Law Group, PLLC
- Agent Vincent M DeLuca
- Priority: GB1821150 20181221
- Main IPC: G06N3/08
- IPC: G06N3/08 ; G06N3/04 ; G06N3/06 ; G06N3/084

Abstract:
Methods and systems for identifying quantisation parameters for a Deep Neural Network (DNN). The method includes determining an output of a model of the DNN in response to training data, the model of the DNN comprising one or more quantisation blocks configured to transform a set of values input to a layer of the DNN prior to processing the set of values in accordance with the layer, the transformation of the set of values simulating quantisation of the set of values to a fixed point number format defined by one or more quantisation parameters; determining a cost metric of the DNN based on the determined output and a size of the DNN based on the quantisation parameters; back-propagating a derivative of the cost metric to one or more of the quantisation parameters to generate a gradient of the cost metric for each of the one or more quantisation parameters; and adjusting one or more of the quantisation parameters based on the gradients.
Information query