Invention Grant
- Patent Title: Power optimization in an artificial intelligence processor
-
Application No.: US16216194Application Date: 2018-12-11
-
Publication No.: US10884485B2Publication Date: 2021-01-05
- Inventor: Sushma Honnavara-Prasad
- Applicant: Groq, Inc.
- Applicant Address: US CA Menlo Park
- Assignee: Groq, Inc.
- Current Assignee: Groq, Inc.
- Current Assignee Address: US CA Menlo Park
- Agency: Fenwick & West LLP
- Main IPC: G06F1/32
- IPC: G06F1/32 ; G06F1/329 ; G06F1/28 ; G06F9/48 ; G06N3/04 ; G06N3/08

Abstract:
In one embodiment, the present disclosure includes a method of reducing power in an artificial intelligence processor. For each cycle, over a plurality of cycles, an AI model is translated into operations executable on an artificial intelligence processor. The translating is based on power parameters that correspond to power consumption and performance of the artificial intelligence processor. The AI processor is configured with the executable operations, and input activation data sets are processed. Accordingly, result sets, power consumption data, and performance data are generated and stored over the plurality of cycles. The method further includes training an AI algorithm using the stored parameters, the power consumption data, and the performance data. A trained AI algorithm outputs a plurality of optimized parameters to reduce power consumption of the AI processor. The AI model is then translated into optimized executable operations based on the plurality of optimized parameters.
Public/Granted literature
- US20200183476A1 POWER OPTIMIZAITON IN AN ARTIFICIAL INTELLIGENCE PROCESSOR Public/Granted day:2020-06-11
Information query