Invention Grant
- Patent Title: Method and apparatus for configuring relevant parameters of MapReduce applications
-
Application No.: US14813467Application Date: 2015-07-30
-
Publication No.: US10831716B2Publication Date: 2020-11-10
- Inventor: Jie Liu , Ju Wei Shi , Chen Wang , Yong Zheng , Jia Zou
- Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Applicant Address: US NY Armonk
- Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Current Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Current Assignee Address: US NY Armonk
- Agency: Cantor Colburn LLP
- Agent Joseph Petrokaitis
- Priority: com.zzzhc.datahub.patent.etl.us.BibliographicData$PriorityClaim@1a302cc7
- Main IPC: G06F16/182
- IPC: G06F16/182

Abstract:
Method and apparatus for configuring relevant parameters of MapReduce applications. The method includes: receiving a request for processing a first MapReduce job; obtaining job feature attributes of historical MapReduce jobs; searching out a job feature attribute of a second MapReduce job associated with the first MapReduce job from within the job feature attributes of the historical MapReduce jobs; configuring relevant parameters of the first MapReduce job based on the job feature attribute of the second MapReduce job. According to this method of configuring parameters, network overheads of file transfer can be effectively reduced, the method of configuring parameters of the MapReduce job can be processed locally as much as possible, thereby effectively increasing system resource utilization while reducing the administrator's configuration burden. An apparatus for configuring relevant parameters of MapReduce application is also provided.
Public/Granted literature
- US20160034482A1 METHOD AND APPARATUS FOR CONFIGURING RELEVANT PARAMETERS OF MAPREDUCE APPLICATIONS Public/Granted day:2016-02-04
Information query