Invention Grant
US08744994B2 Data filtering and optimization for ETL (extract, transform, load) processes
失效
ETL(提取,转换,加载)过程的数据过滤和优化
- Patent Title: Data filtering and optimization for ETL (extract, transform, load) processes
- Patent Title (中): ETL(提取,转换,加载)过程的数据过滤和优化
-
Application No.: US12343021Application Date: 2008-12-23
-
Publication No.: US08744994B2Publication Date: 2014-06-03
- Inventor: Ying Chen , Bin He , Rui Wang
- Applicant: Ying Chen , Bin He , Rui Wang
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agency: Shimokaji & Assoc., P.C.
- Main IPC: G06F7/00
- IPC: G06F7/00 ; G06F17/30

Abstract:
A method and system are disclosed for use with an ETL (Extract, Transform, Load) process, comprising optimizing a filter expression to select a subset of data and evaluating the filter expression on the data after the extracting, before the loading, but not during the transforming of the ETL process. The method and system optimizes the filtering using a pipelined evaluation for single predicate filtering and an adaptive optimization for multiple predicate filtering. The adaptive optimization includes an initial phase and a dynamic phase.
Public/Granted literature
- US20100161576A1 DATA FILTERING AND OPTIMIZATION FOR ETL (EXTRACT, TRANSFORM, LOAD) PROCESSES Public/Granted day:2010-06-24
Information query