Invention Grant
- Patent Title: Prefetch chaining for optimizing data read-ahead for workflow and analytics
-
Application No.: US17134715Application Date: 2020-12-28
-
Publication No.: US11429429B2Publication Date: 2022-08-30
- Inventor: Wayne Sawdon , Deepavali M. Bhagwat
- Applicant: International Business Machines Corporation
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agency: Sherman IP LLP
- Agent Kenneth L. Sherman; Steven Laut
- Main IPC: G06F9/48
- IPC: G06F9/48 ; G06F9/50

Abstract:
One embodiment provides a method for optimizing data read-ahead for machine learning applications including obtaining, by a processor, next file information from a workflow scheduler for next input files for a next processing stage that are to be accessed by a machine learning application. Data for the next processing stage for the machine learning application and at least one system job is prefetched. The next input files are prefetched as the prefetching data reaches an end of current inputs. A schedule is caused to chain the next input files for the next processing stage to current input files of a current processing stage.
Public/Granted literature
- US20210117228A1 PREFETCH CHAINING FOR OPTIMIZING DATA READ-AHEAD FOR WORKFLOW AND ANALYTICS Public/Granted day:2021-04-22
Information query