Invention Grant
- Patent Title: Bucket merging for a data intake and query system using size thresholds
-
Application No.: US17661510Application Date: 2022-04-29
-
Publication No.: US11720537B2Publication Date: 2023-08-08
- Inventor: Tameem Anwar , Tianyi Gou , Alexandros Batsakis , Abhinav Prasad Nekkanti , Sai Krishna Sajja , Jiahan Wang
- Applicant: Splunk Inc.
- Applicant Address: US CA San Francisco
- Assignee: Splunk Inc.
- Current Assignee: Splunk Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Knobbe, Martens, Olson & Bear LLP
- Main IPC: G06F16/22
- IPC: G06F16/22 ; G06F16/14 ; G06F16/16

Abstract:
Systems and methods are disclosed for scalable bucket merging in a data intake and query system. Various components of a bucket manager can be used to monitor recently-created buckets of data in common storage that are associated with a particular tenant and a particular index, apply a comprehensive bucket merge policy to determine groups of buckets that qualify for merging, merge those group of buckets into merged buckets to be stored in the common storage, and update any information associated with the merged buckets and pre-merged buckets. These components may be shared across multiple tenants, and some of these components may be dynamically scalable based on need. This approach may also provide many additional benefits, including improved search performance from merged buckets, efficient resource utilization associated with discriminate merging, and redundancy in case of component failure.
Public/Granted literature
- US20220261385A1 BUCKET MERGING FOR A DATA INTAKE AND QUERY SYSTEM USING SIZE THRESHOLDS Public/Granted day:2022-08-18
Information query