Invention Grant
- Patent Title: Adaptive endpoint selection
-
Application No.: US14486894Application Date: 2014-09-15
-
Publication No.: US10432711B1Publication Date: 2019-10-01
- Inventor: Christopher Magee Greenwood , James Michael Thompson , Kristina Kraemer Brenneman
- Applicant: Amazon Technologies, Inc.
- Applicant Address: US NV Reno
- Assignee: Amazon Technologies, Inc.
- Current Assignee: Amazon Technologies, Inc.
- Current Assignee Address: US NV Reno
- Agency: Klarquist Sparkman LLP
- Main IPC: G06F15/16
- IPC: G06F15/16 ; H04L29/08 ; H04L29/06

Abstract:
A method for selecting a service endpoint from a plurality of service endpoints in a distributed system of a service provider may include storing processing data for each of the plurality of endpoints. A success rate may be calculated for each of the plurality of service endpoints and based on a number of processed requests from a plurality of received requests. An average latency may be calculated based on latency associated with each of the processed requests. A latency score may be calculated based on a minimum average latency and the average latency. A raw score may be calculated based on the latency score and the success rate. A selection weight may be calculated based on the raw score and a balancing parameter. One of the plurality of endpoints may be selected based on the selection weight.
Information query