Invention Grant
- Patent Title: Dynamic management of weight update bit length
-
Application No.: US16596716Application Date: 2019-10-08
-
Publication No.: US11574196B2Publication Date: 2023-02-07
- Inventor: Tayfun Gokmen
- Applicant: International Business Machines Corporation
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agency: Otterstedt & Kammer PLLC
- Agent Kristofer Haggerty
- Main IPC: G06N3/08
- IPC: G06N3/08 ; G06N3/04 ; G06N3/063

Abstract:
Machine learning is enhanced by efficiently updating a weight that is represented as a conductivity of a resistive processing unit (RPU) that is connected between a row wire and a column wire. The weight is updated by the RPU interacting with bit streams carried on the row and column wires. Efficiency of the update is enhanced by calculating a bit length for the bit streams as a function of factors that include learning rate η, maximum activity xmax, maximum error differential δmax, and minimum weight update increment Δwmin.
Public/Granted literature
- US20210103821A1 DYNAMIC MANAGEMENT OF WEIGHT UPDATE BIT LENGTH Public/Granted day:2021-04-08
Information query