Invention Grant
- Patent Title: Performing automatic map reduce job optimization using a resource supply-demand based approach
-
Application No.: US15140830Application Date: 2016-04-28
-
Publication No.: US10013289B2Publication Date: 2018-07-03
- Inventor: David S. Kung , Dung Phan , Jinjun Xiong
- Applicant: International Business Machines Corporation
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agency: Scully, Scott, Murphy & Presser, P.C.
- Agent Daniel P. Morris, Esq.
- Main IPC: G06F9/46
- IPC: G06F9/46 ; G06F9/50

Abstract:
Determining optimum values for Map Reduce parameters by identifying parameters that affect performance of a Map Reduce job, determining a relationship between each of the identified parameters and a maximization of resource utilization for a plurality of computing resources configured for executing the Map Reduce job, representing a workflow based upon supply-demand relationships among the plurality of computing resources, modeling an execution cost as a function of the plurality of identified parameters, formulating a non-linear programming problem to minimize the execution cost, reformulating the non-linear programming problem as a linear programming problem, and solving the linear programming problem to determine a combination of parameter values for the plurality of identified parameters that minimizes the execution cost for the Map Reduce job.
Public/Granted literature
- US20170315848A1 PERFORMING AUTOMATIC MAP REDUCE JOB OPTIMIZATION USING A RESOURCE SUPPLY-DEMAND BASED APPROACH Public/Granted day:2017-11-02
Information query