Invention Grant
- Patent Title: Distributed columnar data set subset retrieval
-
Application No.: US17039584Application Date: 2020-09-30
-
Publication No.: US11263175B2Publication Date: 2022-03-01
- Inventor: Brian Payton Bowman , Gordon Lyle Keener , Richard Todd Knight
- Applicant: SAS Institute Inc.
- Applicant Address: US NC Cary
- Assignee: SAS Institute Inc.
- Current Assignee: SAS Institute Inc.
- Current Assignee Address: US NC Cary
- Agency: Kacvinsky Daisak Bluni PLLC
- Main IPC: G06F16/13
- IPC: G06F16/13 ; G06F9/50 ; G06F3/06 ; G06F12/02 ; G06F21/60 ; G06F16/27 ; G06F16/182 ; G06F16/22

Abstract:
An apparatus includes a processor to: within each reading thread, retrieve a data set part and corresponding part metadata from storage device(s), analyze row group metadata for each row group within the data set part to identify candidate row group(s) meeting specified criteria, and store the candidate row group(s) and corresponding row group metadata within a data buffer of a queue; operate the queue as a FIFO buffer; within each provision thread, retrieve one of multiple row groups and corresponding metadata from within the data buffer, use information in the metadata to identify rows meeting the criteria, and provide those rows to the requesting device or an application; and in response to each instance of storage of a data set part within a data buffer of the queue, analyze the availability of storage space and/or of processing resources to determine whether to dynamically adjust the quantity of reading threads.
Public/Granted literature
- US20210026806A1 DISTRIBUTED COLUMNAR DATA SET SUBSET RETRIEVAL Public/Granted day:2021-01-28
Information query