Invention Grant
US08996464B2 Efficient partitioning techniques for massively distributed computation
有权
用于大规模分布式计算的高效分区技术
- Patent Title: Efficient partitioning techniques for massively distributed computation
- Patent Title (中): 用于大规模分布式计算的高效分区技术
-
Application No.: US13494006Application Date: 2012-06-11
-
Publication No.: US08996464B2Publication Date: 2015-03-31
- Inventor: Jingren Zhou , Nicolas Bruno , Wei Lin
- Applicant: Jingren Zhou , Nicolas Bruno , Wei Lin
- Applicant Address: US WA Redmond
- Assignee: Microsoft Technology Licensing, LLC
- Current Assignee: Microsoft Technology Licensing, LLC
- Current Assignee Address: US WA Redmond
- Agent Ben Tabor; Kate Drakos; Micky Minhas
- Main IPC: G06F17/30
- IPC: G06F17/30 ; G06F9/50

Abstract:
A repartitioning optimizer identifies alternative repartitioning strategies and selects optimal ones, accounting for network transfer utilization and partition sizes in addition to traditional metrics. If prior partitioning was hash-based, the repartitioning optimizer can determine whether a hash-based repartitioning can result in not every computing device providing data to every other computing device. If prior partitioning was range-based, the repartitioning optimizer can determine whether a range-based repartitioning can generate similarly sized output partitions while aligning input and output partition boundaries, increasing the number of computing devices that do not provide data to every other computing device. Individual computing devices, as they are performing a repartitioning, assign a repartitioning index to each individual data element, which represents the computing device to which such a data element is destined. The indexed data is sorted by such repartitioning indices, thereby grouping together all like data, and then stored in a sequential manner.
Public/Granted literature
- US20130332446A1 EFFICIENT PARTITIONING TECHNIQUES FOR MASSIVELY DISTRIBUTED COMPUTATION Public/Granted day:2013-12-12
Information query