Invention Grant
- Patent Title: Distributed computing with adaptive parallelization
-
Application No.: US15269936Application Date: 2016-09-19
-
Publication No.: US10296380B1Publication Date: 2019-05-21
- Inventor: Josue Isai Vazquez Garcia , Vasileios Lekakis , Sanjay Kumar , Paul Kim
- Applicant: Amazon Technologies, Inc.
- Applicant Address: US WA Seattle
- Assignee: Amazon Technologies, Inc.
- Current Assignee: Amazon Technologies, Inc.
- Current Assignee Address: US WA Seattle
- Agency: Meyertons, Hood, Kivlin, Kowert & Goetzel, P.C
- Agent Robert C. Kowert
- Main IPC: G06F9/46
- IPC: G06F9/46 ; G06F9/48

Abstract:
Methods, systems, and computer-readable media for distributed computing with adaptive parallelization are disclosed. An execution time metric is determined based (at least in part) on execution of a batch of jobs. A quantity of partitions for an additional batch of jobs is determined based (at least in part) on the execution time metric and on a target metric. The additional batch of jobs is divided between a set of partitions of the determined quantity. Execution is initiated of the additional batch of jobs in the set of partitions. The set of partitions comprises at least a first partition and a second partition. A first subset of jobs in the first partition is executed in parallel with a second subset of jobs in the second partition.
Information query