公开(公告)号：US11789950B1

公开(公告)日：2023-10-17

申请号：US17074445

申请日：2020-10-19

Applicant: Splunk Inc.

Inventor： Paul Jean André Bernier ,  Poornima Devaraj ,  Ivneet Kaur ,  Zhimin Liang ,  Min Zhang

IPC: G06F16/2455 ,  G06F16/22 ,  G06F16/25

CPC classification number: G06F16/24568 ,  G06F16/22 ,  G06F16/254

Abstract: Systems and methods are described for a streaming data processing system that defers processing of some data based on a determined importance of the data. A streaming data processing system can ingest a data stream that contains multiple events, and can extract data field values from individual events and process the data field values to determine event importance. The streaming data processing system can then do further processing and indexing of high importance events, and can generate a storage prefix for each low importance event that determines where to store the low importance event in a data storage system. The streaming data processing system can then process queries by retrieving the indexed high importance events, and can extract the data field values from a high importance event to determine the storage prefix for retrieving corresponding low importance events from the data storage system.