Invention Grant
- Patent Title: Systems and methods for performing data processing operations using variable level parallelism
-
Application No.: US15939820Application Date: 2018-03-29
-
Publication No.: US10817495B2Publication Date: 2020-10-27
- Inventor: Garth Allen Dickie
- Applicant: Ab Initio Technology LLC
- Applicant Address: US MA Lexington
- Assignee: Ab Inito Technology LLC
- Current Assignee: Ab Inito Technology LLC
- Current Assignee Address: US MA Lexington
- Agency: Wolf, Greenfield & Sacks, P.C.
- Main IPC: G06F17/00
- IPC: G06F17/00 ; G06F16/22 ; G06F16/23 ; G06F16/2455 ; G06F9/50

Abstract:
Techniques for determining processing layouts to nodes of a dataflow graph. The techniques include: obtaining information specifying a dataflow graph, the dataflow graph comprising a plurality of nodes and a plurality of edges connecting the plurality nodes, the plurality of edges representing flows of data among nodes in the plurality of nodes, the plurality of nodes comprising: a first set of one or more nodes; and a second set of one or more nodes disjoint from the first set of nodes; obtaining a first set of one or more processing layouts for the first set of nodes; and determining a processing layout for each node in the second set of nodes based on the first set of processing layouts and one or more layout determination rules, the one or more layout determination rules including at least one rule for selecting among processing layouts having different degrees of parallelism.
Public/Granted literature
- US20180285401A1 SYSTEMS AND METHODS FOR PERFORMING DATA PROCESSING OPERATIONS USING VARIABLE LEVEL PARALLELISM Public/Granted day:2018-10-04
Information query