Invention Grant
- Patent Title: Live resegmenting of partitions in distributed stream-processing platforms
-
Application No.: US15908465Application Date: 2018-02-28
-
Publication No.: US10608951B2Publication Date: 2020-03-31
- Inventor: Andrey Efimov , John Christopher Petry , Julien Nicolas Dollon , Nathaniel Martin Glass
- Applicant: Oracle International Corporation
- Applicant Address: US CA Redwood Shores
- Assignee: Oracle International Corporation
- Current Assignee: Oracle International Corporation
- Current Assignee Address: US CA Redwood Shores
- Agency: Invoke
- Main IPC: H04L12/917
- IPC: H04L12/917 ; H04L29/08 ; H04L12/911

Abstract:
Techniques for resegmenting a partition in a distributed stream-processing platform are provided. The techniques include receiving a trigger to move a partition of the distributed stream-processing platform from a first broker on a first set of physical resources to a second broker on a second a set of physical resources. In response to the trigger, the partition is allocated on the second broker, and the first broker is configured to redirect, to the second broker, requests for new messages after a last offset in the partition without replicating older messages before the last offset to the second broker. Idempotent produce metadata for the partition from the first broker is then merged into the second broker. Finally, metadata for processing requests for the partition is updated to include the second broker.
Public/Granted literature
- US20190104082A1 LIVE RESEGMENTING OF PARTITIONS IN DISTRIBUTED STREAM-PROCESSING PLATFORMS Public/Granted day:2019-04-04
Information query