Invention Grant
- Patent Title: Node topology employing recirculating ring command and data buffers for executing thread scheduling
-
Application No.: US16416179Application Date: 2019-05-18
-
Publication No.: US10540740B2Publication Date: 2020-01-21
- Inventor: Val G. Cook , Satyaki Koneru , Ke Yin , Dinakar C. Munagala
- Applicant: Thinci, Inc.
- Applicant Address: US CA El Dorado Hills
- Assignee: Blaize, Inc.
- Current Assignee: Blaize, Inc.
- Current Assignee Address: US CA El Dorado Hills
- Agent Brian R. Short
- Main IPC: G06T1/60
- IPC: G06T1/60 ; G06T15/00

Abstract:
The claimed invention discloses system comprising a plurality of logical nodes comprised in a single or plurality of stages, with defined properties and resources associated with each node, for reducing compute resources, said system further comprising: at least a recirculating ring buffer holding only any one of a control information, input, and, or out data necessary to stream a temporary data between node and, or nodes in an execution graph, thereby reducing size of said recirculating ring buffer; said recirculating ring buffer being sufficiently reduced in size to reside in an on-chip cache, such that any one of the control information, input, and, or out data between node and, or nodes need not be stored in memory; wherein the control information further comprises a command related to invalidating any one of the input and, or out data held in a recirculating ring data buffer, clearing the buffer of tasked data; and wherein a producer is stalled from writing any more control information into a recirculating ring command buffer upon the buffer being full, preventing command buffer over-writing, and thereby reducing compute resources associated with a DRAM memory transaction.
Public/Granted literature
- US20190325551A1 Node Topology Employing Recirculating Ring Command and Data Buffers for Executing Thread Scheduling Public/Granted day:2019-10-24
Information query