Invention Grant
- Patent Title: System for continuous monitoring of data quality in a dynamic feed environment
-
Application No.: US16257936Application Date: 2019-01-25
-
Publication No.: US10977147B2Publication Date: 2021-04-13
- Inventor: Vladislav Shkapenyuk , Tamraparni Dasu , Divesh Srivastava , Deborah Swayne
- Applicant: AT&T Intellectual Property I, L.P.
- Applicant Address: US GA Atlanta
- Assignee: AT&T Intellectual Property I, L.P.
- Current Assignee: AT&T Intellectual Property I, L.P.
- Current Assignee Address: US GA Atlanta
- Agency: Hartman & Citrin LLC
- Main IPC: G06F11/30
- IPC: G06F11/30 ; G06F16/28

Abstract:
A system for providing continuous monitoring of data quality in a dynamic feed environment is disclosed. In particular, the system utilizes a feed inspection tool to detect anomalies in data gathering detected from feed metadata and anomalies in data measurement detected based on file contents. In order to do so, the feed inspection tool may aggregate, for a plurality of aggregation intervals, data feeds and associated metadata feeds. Once the data feeds and metadata feeds are aggregated, the feed inspection tool may generate, for a baseline model feed, baseline statistical models by utilizing historical data of the aggregated feeds in sliding windows of different lengths. The feed inspection tool may then identify, for a plurality of monitoring time delays, data outliers by comparing the aggregated feeds with the baseline model feed. A data quality feed based on the data outliers identified may then be generated and published.
Public/Granted literature
- US20190155822A1 System For Continuous Monitoring Of Data Quality In A Dynamic Feed Environment Public/Granted day:2019-05-23
Information query