Invention Grant
- Patent Title: In-memory dataflow execution with dynamic placement of cache operations and action execution ordering
-
Application No.: US16174448Application Date: 2018-10-30
-
Publication No.: US10698821B2Publication Date: 2020-06-30
- Inventor: Vinícius Michel Gottin , Fábio André Machado Porto , Yania Molina Souto
- Applicant: EMC IP Holding Company LLC
- Applicant Address: US MA Hopkinton
- Assignee: EMC IP Holding Company LLC
- Current Assignee: EMC IP Holding Company LLC
- Current Assignee Address: US MA Hopkinton
- Agency: Ryan, Mason & Lewis, LLP
- Main IPC: G06F12/00
- IPC: G06F12/00 ; G06F12/0806 ; G06F17/10

Abstract:
A dataflow execution environment is provided with dynamic placement of cache operations and action execution ordering. An exemplary method comprises: obtaining a current cache placement plan for a dataflow comprised of multiple operations and a corresponding current cache gain estimate; selecting an action to execute from a plurality of remaining dataflow actions based on a predefined policy; executing one or more operations in a lineage of the selected action and estimating an error as a difference in an observed execution time and an estimated execution time given by a cost model; obtaining an alternative cache placement plan for the dataflow following the execution in conjunction with a predefined new plan determination criteria being satisfied and a corresponding alternative cache gain estimate; implementing the alternative cache placement plan in conjunction with a predefined new plan implementation criteria being satisfied; and selecting a next action to execute from a plurality of remaining actions in the dataflow based on a predefined policy.
Public/Granted literature
- US20200133859A1 In-Memory Dataflow Execution with Dynamic Placement of Cache Operations and Action Execution Ordering Public/Granted day:2020-04-30
Information query