Invention Grant
- Patent Title: Resource management in MapReduce architecture and architectural system
-
Application No.: US15276963Application Date: 2016-09-27
-
Publication No.: US09720740B2Publication Date: 2017-08-01
- Inventor: Li Li , Ju Wei Shi , Qi Yu , Jia Zou
- Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Applicant Address: US NY Armonk
- Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Current Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Current Assignee Address: US NY Armonk
- Agent Rabin Bhattacharya
- Priority: CN201310037826 20130131
- Main IPC: G06F12/00
- IPC: G06F12/00 ; G06F9/50 ; G06F12/02

Abstract:
Resource management in MapReduce architecture and architectural system. The present invention provides an apparatus for resource management in the MapReduce architecture including a memory, a processor communicatively coupled to the memory, and a module for resource management in the MapReduce architecture configured to carry out the steps of a method. The method includes the steps of: determining a ratio r of an input data amount of a Map task, an output data amount of the Map task, and an average size R of a record in Map output results; determining a memory size Memory_size that can be allocated to the Map task corresponding to a Map slot; determining an input split size appropriate for the Map task according to the determined r, R and Memory_size; and allocating an input split with the input split size in a MapReduce job to be processed to the Map task occupying the Map slot.
Public/Granted literature
- US20170017569A1 RESOURCE MANAGEMENT IN MAPREDUCE ARCHITECTURE AND ARCHITECTURAL SYSTEM Public/Granted day:2017-01-19
Information query