Invention Grant
- Patent Title: Data quality analysis
-
Application No.: US15175793Application Date: 2016-06-07
-
Publication No.: US10409802B2Publication Date: 2019-09-10
- Inventor: Chuck Spitz , Joel Gould
- Applicant: Ab Initio Technology LLC
- Applicant Address: US MA Lexington
- Assignee: Ab Initio Technology LLC
- Current Assignee: Ab Initio Technology LLC
- Current Assignee Address: US MA Lexington
- Agency: Fish & Richardson P.C.
- Main IPC: G06F17/00
- IPC: G06F17/00 ; G06F16/23 ; G06F16/248 ; G06F16/2455 ; G06F16/215

Abstract:
A method includes receiving information indicative of an output dataset generated by a data processing system; identifying, based on data lineage information relating to the output dataset, one or more upstream datasets on which the output dataset depends; analyzing one or more of the identified one or more upstream datasets on which the output dataset depends. The analyzing includes, for each particular upstream dataset of the one or more upstream datasets, applying one or more of: (i) a first rule indicative of an allowable deviation between a profile of the particular upstream dataset and a reference profile for the particular upstream dataset, and (ii) a second rule indicative of one or more allowable values or prohibited values for each of one or more data elements in the particular upstream dataset, and based on the results of applying the one or more rules, selecting one or more of the upstream datasets. The method includes outputting information associated with the selected one or more upstream datasets.
Public/Granted literature
- US20160364434A1 DATA QUALITY ANALYSIS Public/Granted day:2016-12-15
Information query