Invention Grant
- Patent Title: Providing strong ordering in multi-stage streaming processing
-
Application No.: US16259745Application Date: 2019-01-28
-
Publication No.: US10592282B2Publication Date: 2020-03-17
- Inventor: Elden Bishop , Jeffrey Chao
- Applicant: salesforce.com, inc.
- Applicant Address: US CA San Francisco
- Assignee: salesforce.com, inc.
- Current Assignee: salesforce.com, inc.
- Current Assignee Address: US CA San Francisco
- Agency: Stern, Kessler, Goldstein & Fox P.L.L.C.
- Main IPC: G06F9/48
- IPC: G06F9/48

Abstract:
The technology disclosed relates to providing strong ordering in multi-stage processing of near real-time (NRT) data streams. In particular, it relates to maintaining current batch-stage information for a batch at a grid-scheduler in communication with a grid-coordinator that controls dispatch of batch-units to the physical threads for a batch-stage. This includes operating a computing grid, and queuing data from the NRT data streams as batches in pipelines for processing over multiple stages in the computing grid. Also included is determining, for a current batch-stage, batch-units pending dispatch, in response to receiving the current batch-stage information; identifying physical threads that processed batch-units for a previous batch-stage on which the current batch-stage depends and have registered pending tasks for the current batch-stage; and dispatching the batch-units for the current batch-stage to the identified physical threads subsequent to complete processing of the batch-units for the previous batch-stage.
Public/Granted literature
- US20190155646A1 PROVIDING STRONG ORDERING IN MULTI-STAGE STREAMNG PROCESSING Public/Granted day:2019-05-23
Information query