Invention Grant
- Patent Title: Systems and methods for failure recovery in at-most-once and exactly-once streaming data processing
-
Application No.: US17383187Application Date: 2021-07-22
-
Publication No.: US12079087B2Publication Date: 2024-09-03
- Inventor: Aniruddha Bohra , Florin Sultan , Umberto Boscolo Bragadin , James Lee , Solomon Lifshits
- Applicant: Akamai Technologies, Inc.
- Applicant Address: US MA Cambridge
- Assignee: Akamai Technologies, Inc.
- Current Assignee: Akamai Technologies, Inc.
- Current Assignee Address: US MA Cambridge
- Main IPC: G06F11/14
- IPC: G06F11/14 ; G06F11/07 ; H04L1/18 ; H04L1/1867 ; H04L69/10 ; H04L41/0654

Abstract:
This patent document describes failure recovery technologies for the processing of streaming data, also referred to as pipelined data. The technologies described herein have particular applicability in distributed computing systems that are required to process streams of data and provide at-most-once and/or exactly-once service levels. In a preferred embodiment, a system comprises many nodes configured in a network topology, such as a hierarchical tree structure. Data is generated at leaf nodes. Intermediate nodes process the streaming data in a pipelined fashion, sending towards the root aggregated or otherwise combined data from the source data streams towards. To reduce overhead and provide locally handled failure recovery, system nodes transfer data using a protocol that controls which node owns the data for purposes of failure recovery as it moves through the network.
Public/Granted literature
- US20230025059A1 Systems and methods for failure recovery in at-most-once and exactly-once streaming data processing Public/Granted day:2023-01-26
Information query