Invention Grant
- Patent Title: Adaptive resource scheduling for data stream processing
-
Application No.: US15458635Application Date: 2017-03-14
-
Publication No.: US10554577B2Publication Date: 2020-02-04
- Inventor: Khalid Ahmed , Xiao Ming Bao , Kuan Feng , Jun Feng Liu
- Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agent Brian F. Russell; Robert Sullivan
- Main IPC: G06F15/16
- IPC: G06F15/16 ; H04L12/927 ; H04L29/08 ; H04L12/911 ; G06F16/2455 ; G06F9/38 ; G06F9/50

Abstract:
In at least one embodiment of stream processing in a data processing system cluster, a driver requests, from a cluster manager, execution of a first task within a job including a plurality of tasks, as well as a first quantity of resources of the cluster to support execution of the task. At completion of execution of the first task by the cluster, the driver retains for a second task among the plurality of tasks at least a portion of the resources allocated to the first task by the cluster manager. The driver determines a second quantity of the resources to retain for the second task based on a relative priority of the job to other jobs in the cluster and efficiency of the cluster manager in allocating resources to the first task.
Public/Granted literature
- US20180270164A1 ADAPTIVE RESOURCE SCHEDULING FOR DATA STREAM PROCESSING Public/Granted day:2018-09-20
Information query