Invention Grant
- Patent Title: Method and system for large volume data processing
- Patent Title (中): 大容量数据处理方法和系统
-
Application No.: US12601606Application Date: 2009-05-15
-
Publication No.: US08229982B2Publication Date: 2012-07-24
- Inventor: Yipeng Tang , Wenqi Hong
- Applicant: Yipeng Tang , Wenqi Hong
- Applicant Address: US KY Grand Cayman
- Assignee: Alibaba Group Holding Limited
- Current Assignee: Alibaba Group Holding Limited
- Current Assignee Address: US KY Grand Cayman
- Agency: Lee & Hayes, PLLC
- Priority: CN200810097594 20080515
- International Application: PCT/US2009/044127 WO 20090515
- International Announcement: WO2009/140590 WO 20091119
- Main IPC: G06F12/00
- IPC: G06F12/00 ; G06F17/30

Abstract:
This disclosure provides a method and a system for large volume data processing for solving the problem of system collapse caused by processing delays resulting from a failure of processing a large volume of data within a scheduled time. The method allocates a server to divide a source file into multiple small files, according to a source file naming scheme, and allocates multiple servers to distributedly process the small files. The allocation of servers can be based on the filenames named according to a file naming scheme. The disclosed method deploys multiple servers to divide and process large data files, thereby maximally improving the processing power of the system and ensuring the system to complete the processing of the files within scheduled times. Furthermore, the system promises good scalability.
Public/Granted literature
- US20110072058A1 Method and System for Large Volume Data Processing Public/Granted day:2011-03-24
Information query