Invention Grant
- Patent Title: Compression of machine learned models
-
Application No.: US16355338Application Date: 2019-03-15
-
Publication No.: US10558738B1Publication Date: 2020-02-11
- Inventor: Grant Strimel , Sachin Grover
- Applicant: Amazon Technologies, Inc.
- Applicant Address: US WA Seattle
- Assignee: AMAZON TECHNOLOGIES, INC.
- Current Assignee: AMAZON TECHNOLOGIES, INC.
- Current Assignee Address: US WA Seattle
- Agency: K&L Gates LLP
- Main IPC: G06F17/22
- IPC: G06F17/22 ; H03M7/42 ; G06F16/901 ; G06N7/00 ; G10L15/26 ; G06N20/00

Abstract:
Devices and techniques are generally described for compression of natural language processing models. A first index value to a first address of a weight table may be stored in a hash table. The first address may store a first weight associated with a first feature of a natural language processing model. A second index value to a second address of the weight table may be stored in the hash table. The second address may store a second weight associated with a second feature of the natural language processing model. A first code associated with the first feature and comprising a first number of bits may be generated. A second code may be generated associated with the second feature and comprising a second number of bits greater than the first number of bits based on a magnitude of the second weight being greater than a magnitude of the first weight.
Information query