Invention Grant
- Patent Title: Quantization parameter optimization method and quantization parameter optimization device
-
Application No.: US17014699Application Date: 2020-09-08
-
Publication No.: US11748600B2Publication Date: 2023-09-05
- Inventor: Yukihiro Sasagawa
- Applicant: SOCIONEXT INC.
- Applicant Address: JP Kanagawa
- Assignee: SOCIONEXT INC.
- Current Assignee: SOCIONEXT INC.
- Current Assignee Address: JP Kanagawa
- Agency: McDermott Will & Emery LLP
- Priority: JP 19163981 2019.09.09
- Main IPC: G06N3/063
- IPC: G06N3/063 ; G06N3/08 ; G06N20/10 ; G06F18/214 ; G06F18/2431 ; G06F18/2451 ; G06F18/2453

Abstract:
A quantization parameter optimization method includes: determining a cost function in which a regularization term is added to an error function, the regularization term being a function of a quantization error that is an error between a weight parameter of a neural network and a quantization parameter that is a quantized weight parameter; updating the quantization parameter by use of the cost function; and determining, as an optimized quantization parameter of a quantization neural network, the quantization parameter with which a function value derived from the cost function satisfies a predetermined condition, the optimized quantization parameter being obtained as a result of repeating the updating, the quantization neural network being the neural network, the weight parameter of which has been quantized, wherein the function value derived from the regularization term and an inference accuracy of the quantization neural network are negatively correlated.
Public/Granted literature
- US20210073635A1 QUANTIZATION PARAMETER OPTIMIZATION METHOD AND QUANTIZATION PARAMETER OPTIMIZATION DEVICE Public/Granted day:2021-03-11
Information query