Invention Grant
- Patent Title: Method for aggregation optimization of time series data
-
Application No.: US17265284Application Date: 2019-07-18
-
Publication No.: US11714554B2Publication Date: 2023-08-01
- Inventor: Haojun Liao , Shengliang Guan , Hongze Cheng , Jianhui Tao
- Applicant: TAOS DATA
- Applicant Address: CN Beijing
- Assignee: TAOS DATA
- Current Assignee: TAOS DATA
- Current Assignee Address: CN Beijing
- Agency: Greer, Burns & Crain, Ltd.
- Priority: CN 1810879115.0 2018.08.03
- International Application: PCT/CN2019/096452 2019.07.18
- International Announcement: WO2020/024799A 2020.02.06
- Date entered country: 2021-07-09
- Main IPC: G06F3/06
- IPC: G06F3/06

Abstract:
The invention discloses an aggregation optimized processing method for time-series data, characterized by comprising the following steps:
writing a time-series data record into a database, forming a time-series database file, wherein the time-series database file comprises a data file and an index file, the data file comprises multiple data blocks, the index file comprises index blocks, and each index block correspond to one data block;
by scanning an index file according to a start time period and a stop time period, extracting all index blocks of the time series that need to be aggregated that meet the time period conditions, and then sorting the index blocks according to the data block offset recorded in the index block; and
by scanning the data file according to a data block offset order recorded in sorted index blocks, performing specified reading and calculating on each data block, and aggregating calculation results. According to the method, the reading of a single time series data or the aggregation operation of multiple time-series data can be completed by only opening a data file once for scanning such that the overall performance is greatly improved.
writing a time-series data record into a database, forming a time-series database file, wherein the time-series database file comprises a data file and an index file, the data file comprises multiple data blocks, the index file comprises index blocks, and each index block correspond to one data block;
by scanning an index file according to a start time period and a stop time period, extracting all index blocks of the time series that need to be aggregated that meet the time period conditions, and then sorting the index blocks according to the data block offset recorded in the index block; and
by scanning the data file according to a data block offset order recorded in sorted index blocks, performing specified reading and calculating on each data block, and aggregating calculation results. According to the method, the reading of a single time series data or the aggregation operation of multiple time-series data can be completed by only opening a data file once for scanning such that the overall performance is greatly improved.
Public/Granted literature
- US20210333994A1 METHOD FOR AGGREGATION OPTIMIZATION OF TIME SERIES DATA Public/Granted day:2021-10-28
Information query