Invention Grant
- Patent Title: Data drift handling
-
Application No.: US16881761Application Date: 2020-05-22
-
Publication No.: US11630840B2Publication Date: 2023-04-18
- Inventor: Hari Shreedharan
- Applicant: StreamSets, Inc.
- Applicant Address: US CA San Francisco
- Assignee: StreamSets, Inc.
- Current Assignee: StreamSets, Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Schwegman Lundberg & Woessner, P.A.
- Main IPC: G06F16/27
- IPC: G06F16/27 ; G06F16/21

Abstract:
Systems and methods herein describe embodiments for handling a data drift. An example system accesses the data pipeline, which is comprised of a plurality of stages. For each stage of the plurality of stages in the data pipeline, the system identifies stage schema fields for processing data in the data pipeline and generates a set of stage schema fields comprising the identified stage schema fields in the stage. In response to detecting an origin stage, the system generates a set of pipeline schema fields, whereby the set of pipeline schema fields comprise a union of the generated sets of stage schema fields. The set of pipeline schema fields are then stored.
Public/Granted literature
- US20210365475A1 DATA DRIFT HANDLING Public/Granted day:2021-11-25
Information query