Invention Grant
- Patent Title: Projections for big database systems
-
Application No.: US17444715Application Date: 2021-08-09
-
Publication No.: US11620280B2Publication Date: 2023-04-04
- Inventor: Benjamin Duffield , Joshua Casale , Mark Elliot , Matthew Sills , Robert Kruszewski , Rahij Ramsharan
- Applicant: Palantir Technologies Inc.
- Applicant Address: US CO Denver
- Assignee: Palantir Technologies Inc.
- Current Assignee: Palantir Technologies Inc.
- Current Assignee Address: US CO Denver
- Agency: Knobbe, Martens, Olson & Bear, LLP
- Main IPC: G06F16/23
- IPC: G06F16/23 ; G06F16/27 ; G06F16/2455 ; G06F16/248

Abstract:
A database system comprised of a decoupled compute layer and storage layer is implemented to store, build, and maintain a canonical dataset, a temporary buffer, and projection datasets. The canonical dataset is a set of batch updated data. The data is appended in chunks to the canonical dataset such that the canonical dataset becomes a historical dataset over time. The buffer is a write ahead log that contains the most recent chunks of data and provides atomicity and durability for the database system. The projection datasets are indexes of the canonical dataset and/or the buffer that may have single or multiple column sort-orders and/or particular data formats. The writes to the canonical dataset, projection datasets, and buffer may be asynchronous and therefore the database system is advantageously less resource constrained.
Public/Granted literature
- US20220058183A1 PROJECTIONS FOR BIG DATABASE SYSTEMS Public/Granted day:2022-02-24
Information query