Invention Grant
- Patent Title: System and method for a task management library to execute map-reduce applications in a map-reduce framework
-
Application No.: US12642849Application Date: 2009-12-20
-
Publication No.: US09619291B2Publication Date: 2017-04-11
- Inventor: Lluís Garcia Pueyo , Roelof van Zwol
- Applicant: Lluís Garcia Pueyo , Roelof van Zwol
- Applicant Address: US CA Sunnyvale
- Assignee: Yahoo! Inc.
- Current Assignee: Yahoo! Inc.
- Current Assignee Address: US CA Sunnyvale
- Agency: Cooper Legal Group, LLC
- Main IPC: G06F9/50
- IPC: G06F9/50

Abstract:
An improved system and method for a task management library to execute map-reduce applications is provided. A map-reduce application may be operably coupled to a task manager library and a map-reduce library on a client device. The task manager library may include a wrapper application programming interface that provides application programming interfaces invoked by a wrapper to parse data input values of the map-reduce application. The task manager library may also include a configurator that extracts data and parameters of the map-reduce application from a configuration file to configure the map-reduce application for execution, a scheduler that determines an execution plan based on input and output data dependencies of mappers and reducers, a launcher that iteratively launches the mappers and reducers according to the execution plan, and a task executor that requests the map-reduce library to invoke execution of mappers on mapper servers and reducers on reducer servers.
Public/Granted literature
Information query