Invention Grant
- Patent Title: Tail latency-based job offloading in load-balanced groups
-
Application No.: US15368763Application Date: 2016-12-05
-
Publication No.: US10768997B2Publication Date: 2020-09-08
- Inventor: Kanak B. Agarwal , Wenzhi Cui , Wesley M. Felter , Yu Gu , Eric J. Rozner
- Applicant: International Business Machines Corporation
- Applicant Address: US NY Armonk
- Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Current Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Current Assignee Address: US NY Armonk
- Agency: Garg Law Firm, PLLC
- Agent Rakesh Garg; Brian Welle
- Main IPC: G06F9/50
- IPC: G06F9/50 ; G06F3/06 ; H04L12/803 ; H04L12/933

Abstract:
A type of a request that is currently being processed at a system is determined. A distribution is selected from a set of processing time distributions, the distribution forming a model that is applicable to the type. A threshold point is computed for the model. A processing time that exceeds a threshold point processing time is regarded as exhibiting tail latency. Tail latency includes a delay in processing of the request due to a reason other than a utilization of a resource of the system exceeding a threshold utilization and a size of a queue in the system exceeding a threshold size. An evaluation is made that the request will experience tail latency during processing at the system and the processing of the request at the system is aborted. The request is offloaded for processing at a peer system in a load-balanced group of systems.
Public/Granted literature
- US20180157539A1 TAIL LATENCY-BASED JOB OFFLOADING IN LOAD-BALANCED GROUPS Public/Granted day:2018-06-07
Information query