Invention Grant
- Patent Title: Effective method to compress tabular data export files for data movement
-
Application No.: US15081860Application Date: 2016-03-26
-
Publication No.: US09916319B2Publication Date: 2018-03-13
- Inventor: Srini Bhagavan , Gerald G. Kiernan
- Applicant: International Business Machines Corporation
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agency: North Shore Patents, P.C.
- Agent Michele Liu Baillie
- Main IPC: G06F7/00
- IPC: G06F7/00 ; G06F17/00 ; G06F17/30

Abstract:
Compression of data for database movement, includes: selecting a first group of categorical columns for compression; selecting a next group of categorical columns from remaining columns for compression; repeating the selecting of the next group until a predetermined compression threshold is met; creating first compression files comprising compressed representations of the columns in the first group; creating next compression files comprising compressed representations of the columns in each of the next groups; storing initial row sort order, group identity, and column positions corresponding to each of the next groups; and storing any columns not selected for compression in an uncompressed file in the original row sort order. Decompression of the data includes: rebuilding categorical columns in each group of compression files using group identity and column positions corresponding to the group; and sorting rows comprising the rebuilt categorical columns to the initial row sort order.
Public/Granted literature
- US20160210305A1 EFFECTIVE METHOD TO COMPRESS TABULAR DATA EXPORT FILES FOR DATA MOVEMENT Public/Granted day:2016-07-21
Information query