公开(公告)号：US12106149B2

公开(公告)日：2024-10-01

申请号：US18140086

申请日：2023-04-27

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F9/46 ,  G06F9/50 ,  G06F9/54 ,  H04L67/1001

CPC classification number: G06F9/5027 ,  G06F9/5077 ,  G06F9/5083 ,  G06F9/542 ,  H04L67/1001 ,  G06F2209/5011

Abstract: Embodiments of the present disclosure may provide dynamic and fair assignment techniques for allocating resources on a demand basis. Assignment control may be separated into at least two components: a local component and a global component. Each component may have an active dialog with each other; the dialog may include two aspects: 1) a demand for computing resources, and 2) a total allowed number of computing resources. The global component may allocate resources from a pool of resources to different local components, and the local components in turn may assign their allocated resources to local competing requests. The allocation may also be throttled or limited at various levels.

公开(公告)号：US12019632B2

公开(公告)日：2024-06-25

申请号：US17930165

申请日：2022-09-07

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/24 ,  G06F9/48 ,  G06F16/11 ,  G06F16/14 ,  G06F16/16 ,  G06F16/2453

CPC classification number: G06F16/24542 ,  G06F9/485 ,  G06F16/122 ,  G06F16/148 ,  G06F16/162 ,  G06F16/24539

Abstract: Embodiments of the present disclosure may provide a dynamic query execution model with fault tolerance and failure recovery techniques. Embodiments of the present disclosure may utilize checkpoints to map processed output files to their corresponding input files. Therefore, if an error occurs in processing one or more files, the system may only need to reschedule processing of selected file(s).

公开(公告)号：US11914591B2

公开(公告)日：2024-02-27

申请号：US16831000

申请日：2020-03-26

Applicant: Snowflake Inc.

Inventor： Prasanna Rajaperumal ,  Thierry Cruanes ,  Allison Waingold Lee ,  Igor Demura ,  Jiaqi Yan ,  Benoit Dageville

IPC: G06F16/00 ,  G06F7/00 ,  G06F16/2453

CPC classification number: G06F16/24539

Abstract: Systems, methods, and devices for sharing materialized views in multiple tenant database systems. A method includes defining a materialized view over a source table that is associated with a first account of a multiple tenant database. The method includes defining cross-account access rights to the materialized view to a second account such that that second account can read the materialized view without copying the materialized view. The method includes modifying the source table for the materialized view. The method includes identifying whether the materialized view is stale with respect to the source table by merging the materialized view and the source table.

公开(公告)号：US20240020295A1

公开(公告)日：2024-01-18

申请号：US18476693

申请日：2023-09-28

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Benoit Dageville ,  Prasanna Rajaperumal ,  Jiaqi Yan

IPC: G06F16/23 ,  G06F16/24 ,  G06F16/27 ,  G06F16/22

CPC classification number: G06F16/2365 ,  G06F16/2393 ,  G06F16/24 ,  G06F16/278 ,  G06F16/2282

Abstract: Systems, methods, and devices for incrementally refreshing a materialized view are disclosed. A method includes generating a materialized view based on a source table. The method includes merging the source table and the materialized view to generate a merged table to identify whether an update has been executed on the source table that is not reflected in the materialized view. The method includes, in response to detecting an update made to the source table that is not reflected in the materialized view, applying the update to the materialized view.

公开(公告)号：US11809428B2

公开(公告)日：2023-11-07

申请号：US17823572

申请日：2022-08-31

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/2453

CPC classification number: G06F16/24542 ,  G06F16/24537 ,  G06F16/24539

Abstract: Embodiments of the present disclosure may provide a dynamic query execution model. This query execution model may provide acceleration by scaling out parallel parts of a query (also referred to as a fragment) to additional computing resources, for example computing resources leased from a pool of computing resources. Execution of the parts of the query may be coordinated by a parent query coordinator, where the query originated, and a fragment query coordinator.

公开(公告)号：US11762855B1

公开(公告)日：2023-09-19

申请号：US17931590

申请日：2022-09-13

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Fabian Hueske ,  Tyler Jones ,  Daniel Mills ,  Leon Papke ,  Prasanna Rajaperumal ,  Daniel E. Sotolongo

IPC: G06F16/2453 ,  G06F7/14

CPC classification number: G06F16/24539 ,  G06F7/14 ,  G06F16/24542

Abstract: Provided herein are systems and methods for a database object (e.g., materialized table) configuration including using the database object for incremental maintenance of query results. For example, a method includes creating a materialized table using a table definition. The table definition includes a query on one or more base tables and a lag duration value. The lag duration value indicates a maximum time period that a result of a prior refresh of the query can lag behind a current time instance. A delta set for the one or more base tables is determined. The delta set includes at least one change applied to the one or more base tables since the prior refresh of the query. The delta set is merged with the materialized table to perform an incremental update of the materialized table.

公开(公告)号：US20230087933A1

公开(公告)日：2023-03-23

申请号：US18059125

申请日：2022-11-28

Applicant: Snowflake Inc.

Inventor： Shrainik Jain ,  Allison Waingold Lee ,  Boyung Lee ,  Prasanna Rajaperumal ,  Jiaqi Yan ,  Yongsik Yoon

IPC: G06F16/2453

Abstract: Queries executed against a materialized view can execute up to orders of magnitude faster than equivalent queries on a source (or base) table. However, although a query can reference a materialized view directly, a user (e.g., query author) may not know about a relevant materialized view. Moreover, if a source table has multiple materialized views generated, the user may not know which materialized view to reference in the query. Thus, embodiments of the present disclosure provide techniques for automatically rewriting queries directed to a source table to utilize existing materialized views.

公开(公告)号：US20230028008A1

公开(公告)日：2023-01-26

申请号：US17930165

申请日：2022-09-07

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/2453 ,  G06F9/48 ,  G06F16/14 ,  G06F16/16 ,  G06F16/11

Abstract: Embodiments of the present disclosure may provide a dynamic query execution model with fault tolerance and failure recovery techniques. Embodiments of the present disclosure may utilize checkpoints to map processed output files to their corresponding input files. Therefore, if an error occurs in processing one or more files, the system may only need to reschedule processing of selected file(s).

公开(公告)号：US11544244B2

公开(公告)日：2023-01-03

申请号：US17654296

申请日：2022-03-10

Applicant: Snowflake Inc.

Inventor： Jiaqi Yan ,  Thierry Cruanes ,  Jeffrey Rosen ,  William Waddington ,  Prasanna Rajaperumal ,  Abdul Munir

IPC: G06F16/22 ,  G06F16/27 ,  G06F7/08 ,  G06F16/28

Abstract: Disclosed herein are embodiments of systems and methods for selecting partitions for reclustering based on distribution of overlapping partitions. In an example, a database platform makes a determination to at least partially recluster a database table that includes data stored across a plurality of partitions. The database platform responsively selects a subset of the partitions. The selecting of the subset includes identifying a point on a domain of a clustering key that corresponds to a local maximum of overlapping partitions, and also includes selecting the subset from among a group of overlapping partitions. The group includes at least one partition that overlaps the identified point on the domain of the clustering key. Each partition in the selected subset is above a reduction goal of overlapping partitions. The database platform at least partially reclusters the selected subset based on the clustering key.

公开(公告)号：US11461325B2

公开(公告)日：2022-10-04

申请号：US17333358

申请日：2021-05-28

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/24 ,  G06F16/14 ,  G06F16/11 ,  G06F16/2453 ,  G06F9/48 ,  G06F16/16

Abstract: Embodiments of the present disclosure may provide a dynamic query execution model with fault tolerance and failure recovery techniques. Embodiments of the present disclosure may utilize checkpoints to map processed output files to their corresponding input files. Therefore, if an error occurs in processing one or more files, the system may only need to reschedule processing of selected file(s).