System and method for input data fault recovery in a massively parallel real time computing system

    公开(公告)号:US10078559B2

    公开(公告)日:2018-09-18

    申请号:US15166724

    申请日:2016-05-27

    Inventor: Benjamin M Howe

    Abstract: A massively parallel real-time computing system receives input data events across many compute nodes, each with a processing algorithm in its processing pipeline. An Event Manager is placed before the algorithm processing pipelines, receives metadata about each incoming event, and collects and organizes it in a database. A fast histogram compares the metadata about each event to that of all the other events, in a processing interval. For sufficiently matching metadata, the events are forwarded to the processing nodes as “regular” events for processing. If the metadata for a processing interval does not match sufficiently, the histogram decides which events are the “correct” events and which events are “incorrect.” The “correct” events are sent on for processing and the “incorrect” events are combined with the “correct” metadata and sent back to the processing nodes to supplement or modify their incoming data to match the other nodes' expectations.

    REDUCING GRANULARITY OF BACKUP DATA OVER TIME
    126.
    发明申请

    公开(公告)号:US20180253357A1

    公开(公告)日:2018-09-06

    申请号:US15448510

    申请日:2017-03-02

    CPC classification number: G06F11/1451 G06F16/215 G06F16/219 G06F2201/835

    Abstract: A database may store a plurality of database revisions corresponding to a time period, including a current version and one or more backup versions of a data object. After a threshold time has passed, the database may identify a plurality of time intervals within the time period and identify, for each of the plurality of time intervals, at most one database revision corresponding to the time interval. The database may delete, for each of the plurality of time intervals, all of the database revisions except for the identified at most one database revision. The database may periodically repeat this process to reduce the granularity of backup data over time.

Patent Agency Ranking