Invention Grant
- Patent Title: Unified data processing across streaming and indexed data sets
-
Application No.: US17175518Application Date: 2021-02-12
-
Publication No.: US11615084B1Publication Date: 2023-03-28
- Inventor: Joseph Gabriel Echeverria , Arthur Foelsche , Eric Sammer , Sarah Stanger
- Applicant: Splunk Inc.
- Applicant Address: US CA San Francisco
- Assignee: Splunk Inc.
- Current Assignee: Splunk Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Knobbe, Martens, Olson & Bear, LLP
- Main IPC: G06F17/30
- IPC: G06F17/30 ; G06F16/2453 ; G06F16/14 ; G05B13/00 ; G06N5/00 ; G06N3/00 ; G06F16/24 ; G06F16/2455 ; G06F16/248 ; G06F16/25 ; G06F16/178

Abstract:
Systems and methods are described for unified processing of indexed and streaming data. A system enables users to query indexed data or specify processing pipelines to be applied to streaming data. In some instances, a user may specify a query intended to be run against indexed data, but may specify criteria that includes not-yet-indexed data (e.g., a future time frame). The system may convert the query into a data processing pipeline applied to not-yet-indexed data, thus increasing the efficiency of the system. Similarly, in some instances, a user may specify a data processing pipeline to be applied to a data stream, but specify criteria including data items outside the data stream. For example, a user may wish to apply the pipeline retroactively, to data items that have already exited the data stream. The system can convert the pipeline into a query against indexed data to satisfy the users processing requirements.
Information query