Invention Grant
- Patent Title: Execution-time dynamic range partitioning transformations
-
Application No.: US16872238Application Date: 2020-05-11
-
Publication No.: US11423049B2Publication Date: 2022-08-23
- Inventor: Seyed Omid Fatemieh , Mikhail Entin , Adrian Baras , Pavan Edara , Aleksandras Surna
- Applicant: Google LLC
- Applicant Address: US CA Mountain View
- Assignee: Google LLC
- Current Assignee: Google LLC
- Current Assignee Address: US CA Mountain View
- Agency: Honigman LLP
- Agent Brett A. Krueger
- Main IPC: G06F16/27
- IPC: G06F16/27 ; G06F16/23

Abstract:
A method for execution-time dynamic range partitioning includes receiving user data including a partitioning key and a clustering key. The user data includes a respective number of total rows defining a total data size for the user data. The method also includes identifying storage constraints for the data storage system. The storage constraints include a target file size and a target number of rows per file. The method further includes determining a plurality of split points for the user data based on the storage constraints. The method also includes generating partitioning quantiles from the plurality of split points that define a range between each split point of the plurality of split points. The method further includes range partitioning each row of the user data into files using the partitioning quantiles.
Public/Granted literature
- US20210349648A1 Execution-Time Dynamic Range Partitioning Transformations Public/Granted day:2021-11-11
Information query