Invention Grant
- Patent Title: Big-data processing method and apparatus
-
Application No.: US15481606Application Date: 2017-04-07
-
Publication No.: US10691669B2Publication Date: 2020-06-23
- Inventor: Xiaoli Wang
- Applicant: Huawei Technologies Co., Ltd.
- Applicant Address: CN Shenzhen
- Assignee: HUAWEI TECHNOLOGIES CO., LTD.
- Current Assignee: HUAWEI TECHNOLOGIES CO., LTD.
- Current Assignee Address: CN Shenzhen
- Agency: Conley Rose, P.C.
- Priority: com.zzzhc.datahub.patent.etl.us.BibliographicData$PriorityClaim@2a68de8d
- Main IPC: G06F16/00
- IPC: G06F16/00 ; G06F16/23 ; G06F9/50 ; G06F16/30 ; G06F9/48 ; G06F16/2453 ; G06F16/2455 ; G06F9/455

Abstract:
A big-data processing method is provided. The method includes obtaining multiple key-value pair sets, where each of the key-value pair sets includes at least one key-value pair, and remainders of modulo operations on all key-value pairs in each key-value pair set are the same, calculating a sum of all values included in each key-value pair set to obtain a total value of the values included in each key-value pair set, obtaining a load status of each reduce processor in a reduce processor set, assigning a corresponding key-value pair set to each reduce processor according to the total value of the values included in each key-value pair set and the load status of each reduce processor, and processing the assigned key-value pair set using each reduce processor.
Public/Granted literature
- US20170212923A1 Big-Data Processing Method and Apparatus Public/Granted day:2017-07-27
Information query