Custom stream partitioning services

    公开(公告)号:US12189658B2

    公开(公告)日:2025-01-07

    申请号:US17885169

    申请日:2022-08-10

    Abstract: Techniques are disclosed for partitioning received data for use in a data stream. Data is received during a period of time at a device, such as a data partitioner. The device a) determines that a first subset of the data is for a first system component, b) a second subset of the data is for a second system component, and c) a third subset of the data is for the first system component. Also, determines that a first stream partition is mapped to the first system component and a second stream partition is mapped to the second system component. Based on these determinations, the device assigns the first and third subsets of the data to the first stream partition and the second subset of the data to the second stream partition. Thereafter, the device transmits a stream that includes the first stream partition and the second stream partition.

    CUSTOM STREAM PARTITIONING SERVICES
    2.
    发明公开

    公开(公告)号:US20230297592A1

    公开(公告)日:2023-09-21

    申请号:US17885169

    申请日:2022-08-10

    CPC classification number: G06F16/278 G06F16/22 G06F16/2386

    Abstract: Techniques are disclosed for partitioning received data for use in a data stream. Data is received during a period of time at a device, such as a data partitioner. The device a) determines that a first subset of the data is for a first system component, b) a second subset of the data is for a second system component, and c) a third subset of the data is for the first system component. Also, determines that a first stream partition is mapped to the first system component and a second stream partition is mapped to the second system component. Based on these determinations, the device assigns the first and third subsets of the data to the first stream partition and the second subset of the data to the second stream partition. Thereafter, the device transmits a stream that includes the first stream partition and the second stream partition.

    KEY-BASED AGGREGATION SERVICE
    3.
    发明公开

    公开(公告)号:US20230297436A1

    公开(公告)日:2023-09-21

    申请号:US18061013

    申请日:2022-12-02

    CPC classification number: G06F9/5061 H04L9/08

    Abstract: Techniques are disclosed for aggregating received data from a data stream. Data is received from a particular stream partition to which a device is subscribed, and subsets of the data, from the particular stream partition, are aggregated based on respective keys associated with the subsets of the data. The device determines whether one or more subsets of data, associated with a particular key, meet at least one processing criteria, such as a threshold amount of data, and refraining from processing the aggregated data when the processing criteria is not met. Once additional subset(s) of data associated with the particular key are received, they are aggregated with the one or more subsets of data. When the processing criteria is satisfied, the device processes the aggregated subsets of data associated with the particular key.

    Key-based aggregation service
    4.
    发明授权

    公开(公告)号:US12242897B2

    公开(公告)日:2025-03-04

    申请号:US18061013

    申请日:2022-12-02

    Abstract: Techniques are disclosed for aggregating received data from a data stream. Data is received from a particular stream partition to which a device is subscribed, and subsets of the data, from the particular stream partition, are aggregated based on respective keys associated with the subsets of the data. The device determines whether one or more subsets of data, associated with a particular key, meet at least one processing criteria, such as a threshold amount of data, and refraining from processing the aggregated data when the processing criteria is not met. Once additional subset(s) of data associated with the particular key are received, they are aggregated with the one or more subsets of data. When the processing criteria is satisfied, the device processes the aggregated subsets of data associated with the particular key.

    FIELD EXTRACTION OF HETEROGENEOUS LOG RECORDS WITH RECURSIVE SUB PARSING AT INGEST TIME

    公开(公告)号:US20250103307A1

    公开(公告)日:2025-03-27

    申请号:US18474947

    申请日:2023-09-26

    Abstract: A system and computer-implemented method for a log analytics system that can configure, collect, parse, and analyze log records in an efficient manner. Log records are accessed, each of the log records is associated with a log source. A base parser is identified for parsing a log record based on a type of the log record indicated in the log source. The log record is parsed using the base parser to extract base field values corresponding to base fields. A base-parsed log record is generated on parsing. Sub-parsers are identified using field mappings. The field mappings include base field values mapped to corresponding sub-parsers. The base-parsed log record is parsed using the sub-parsers to extract sub-fields. The sub-fields are merged to the base fields to generate and present an output that includes the parsed log record, the base fields, base field values, the sub-fields and the sub-field values.

Patent Agency Ranking