Invention Grant
- Patent Title: Dynamic tree determination for data processing
-
Application No.: US15344180Application Date: 2016-11-04
-
Publication No.: US10402424B1Publication Date: 2019-09-03
- Inventor: Gavindaswamy Bacthavachalu , Peter Grant Gavares , Ahmed A. Badran , James E. Scharf, Jr.
- Applicant: Amazon Technologies, Inc.
- Applicant Address: US WA Seattle
- Assignee: Amazon Technologies, Inc.
- Current Assignee: Amazon Technologies, Inc.
- Current Assignee Address: US WA Seattle
- Agency: Meyertons, Hood, Kivlin, Kowert & Goetzel, P.C.
- Agent Robert C. Kowert
- Main IPC: G06F17/30
- IPC: G06F17/30 ; G06F16/27 ; G06F9/48 ; G06F16/22 ; G06F16/2455 ; G06F16/2453

Abstract:
Data can be processed in parallel across a cluster of nodes using a parallel processing framework. Using Web services calls between components allows the number of nodes to be scaled as necessary, and allows developers to build applications on the framework using a Web services interface. A job scheduler works together with a queuing service to distribute jobs to nodes as the nodes have capacity, such that jobs can be performed in parallel as quickly as the nodes are able to process the jobs. Data can be loaded efficiently across the cluster, and levels of nodes can be determined dynamically to process queries and other requests on the system.
Information query