Invention Grant
- Patent Title: Mitigating slow instances in large-scale streaming pipelines
-
Application No.: US16670287Application Date: 2019-10-31
-
Publication No.: US11461213B2Publication Date: 2022-10-04
- Inventor: Ashvin Agrawal , Avrilia Floratou , Ke Wang , Daniel E. Musgrave
- Applicant: Microsoft Technology Licensing, LLC
- Applicant Address: US WA Redmond
- Assignee: Microsoft Technology Licensing, LLC
- Current Assignee: Microsoft Technology Licensing, LLC
- Current Assignee Address: US WA Redmond
- Agency: Fiala & Weaver P.L.L.C.
- Main IPC: G06F11/34
- IPC: G06F11/34 ; G06F9/50 ; H04L69/00 ; H04L47/125

Abstract:
A system is described herein for mitigating slow process instances in a streaming application. The system includes a slow process instance candidate identifier configured to identify, based on a relative watermark latency, a set of slow process instance candidates from among a plurality of process instances that comprise the streaming application. The system further includes a set of filters configured to remove false positives from the set of slow process instance candidates. The filters account for window operations performed by the process instances as well as stabilization time needed for downstream process instances to stabilize after a slow upstream process instance is mitigated by a mitigation implementer, which may also be included in the system.
Public/Granted literature
- US20210133075A1 MITIGATING SLOW INSTANCES IN LARGE-SCALE STREAMING PIPELINES Public/Granted day:2021-05-06
Information query