Invention Grant
- Patent Title: End to end validation of data transformation accuracy
-
Application No.: US14175871Application Date: 2014-02-07
-
Publication No.: US10037366B2Publication Date: 2018-07-31
- Inventor: Art Sadovsky , Rustam Lalkaka , Felix Deschamps , Jungrak Kim
- Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
- Applicant Address: US WA Redmond
- Assignee: Microsoft Technology Licensing, LLC
- Current Assignee: Microsoft Technology Licensing, LLC
- Current Assignee Address: US WA Redmond
- Main IPC: G06F17/30
- IPC: G06F17/30 ; G06F21/64

Abstract:
Data is validated as it travels through the different nodes of a data pipeline. Instead of having to wait to validate the data when the data reaches an end of the data pipeline, each node in the pipeline may validate the data. Different methods may be used to validate the data. For example, each node may determine metadata about the received data and/or the transformed data. This metadata may be used to determine if the node is receiving the same amount of data as it usually receives, whether the data is in a same format, and the like. A timing of the data through one or more of the nodes may also be used in determining when the data is valid. When a problem is detected at any of the nodes in the pipeline, a report may be sent to one or more users.
Public/Granted literature
- US20150227595A1 END TO END VALIDATION OF DATA TRANSFORMATION ACCURACY Public/Granted day:2015-08-13
Information query