公开(公告)号：US11347735B2

公开(公告)日：2022-05-31

申请号：US16889033

申请日：2020-06-01

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/2453

Abstract: Embodiments of the present disclosure may provide a dynamic query execution model. This query execution model may provide acceleration by scaling out parallel parts of a query (also referred to as a fragment) to additional computing resources, for example computing resources leased from a pool of computing resources. Execution of the parts of the query may be coordinated by a parent query coordinator, where the query originated, and a fragment query coordinator.

公开(公告)号：US20210374135A1

公开(公告)日：2021-12-02

申请号：US16889033

申请日：2020-06-01

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/2453

Abstract: Embodiments of the present disclosure may provide a dynamic query execution model. This query execution model may provide acceleration by scaling out parallel parts of a query (also referred to as a fragment) to additional computing resources, for example computing resources leased from a pool of computing resources. Execution of the parts of the query may be coordinated by a parent query coordinator, where the query originated, and a fragment query coordinator.

公开(公告)号：US11163768B1

公开(公告)日：2021-11-02

申请号：US16889042

申请日：2020-06-01

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/2453 ,  G06F9/48 ,  G06F16/14 ,  G06F16/16 ,  G06F16/11

Abstract: Embodiments of the present disclosure may provide a dynamic query execution model with fault tolerance and failure recovery techniques. Embodiments of the present disclosure may utilize checkpoints to map processed output files to their corresponding input files. Therefore, if an error occurs in processing one or more files, the system may only need to reschedule processing of selected file(s).

公开(公告)号：US12169490B2

公开(公告)日：2024-12-17

申请号：US18175007

申请日：2023-02-27

Applicant: Snowflake Inc.

Inventor： Varun Ganesh ,  Saiyang Gou ,  Prasanna Rajaperumal ,  Wenhao Song ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/00 ,  G06F16/22 ,  G06F16/2453 ,  G06F16/2455 ,  G06F16/28

Abstract: Methods, systems, and computer programs are presented for providing a cluster view method of a database to perform compaction and clustering of database objects, such as database materialized view. A cluster view system identifies a materialized view including data from one or more base tables, a portion of the data of the materialized view including stale data. The cluster view system performs an integrated task within a maintenance operation on a database, the integrated task including compacting the materialized view, the maintenance operation including clustering the materialized view, and stores the compacted and clustered materialized view in the database.

公开(公告)号：US11593368B1

公开(公告)日：2023-02-28

申请号：US17661545

申请日：2022-04-29

Applicant: Snowflake Inc.

Inventor： Varun Ganesh ,  Saiyang Gou ,  Prasanna Rajaperumal ,  Wenhao Song ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/00 ,  G06F16/2453 ,  G06F16/28 ,  G06F16/22 ,  G06F16/2455

Abstract: A cluster view method of a database to perform compaction and clustering of database objects, such as database materialized view is shown. The database can comprise a cache to store changes to storage units of tables of the database objects. The cluster view method can implement clustering to remove data based on the cache and clustering to group the data of the materialized view.

公开(公告)号：US20220414097A1

公开(公告)日：2022-12-29

申请号：US17823572

申请日：2022-08-31

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/2453

Abstract: Embodiments of the present disclosure may provide a dynamic query execution model. This query execution model may provide acceleration by scaling out parallel parts of a query (also referred to as a fragment) to additional computing resources, for example computing resources leased from a pool of computing resources. Execution of the parts of the query may be coordinated by a parent query coordinator, where the query originated, and a fragment query coordinator.

公开(公告)号：US20220222255A1

公开(公告)日：2022-07-14

申请号：US17657257

申请日：2022-03-30

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/2453

Abstract: Embodiments of the present disclosure may provide a dynamic query execution model. This query execution model may provide acceleration by scaling out parallel parts of a query (also referred to as a fragment) to additional computing resources, for example computing resources leased from a pool of computing resources. Execution of the parts of the query may be coordinated by a parent query coordinator, where the query originated, and a fragment query coordinator.

公开(公告)号：US10860381B1

公开(公告)日：2020-12-08

申请号：US16874388

申请日：2020-05-14

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F9/46 ,  G06F9/50 ,  G06F9/54 ,  H04L29/08

Abstract: Embodiments of the present disclosure may provide dynamic and fair assignment techniques for allocating resources on a demand basis. Assignment control may be separated into at least two components: a local component and a global component. Each component may have an active dialog with each other; the dialog may include two aspects: 1) a demand for computing resources, and 2) a total allowed number of computing resources. The global component may allocate resources from a pool of resources to different local components, and the local components in turn may assign their allocated resources to local competing requests. The allocation may also be throttled or limited at various levels.

公开(公告)号：US20240078135A1

公开(公告)日：2024-03-07

申请号：US18140086

申请日：2023-04-27

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F9/50 ,  G06F9/54 ,  H04L67/1001

CPC classification number: G06F9/5027 ,  G06F9/5077 ,  G06F9/5083 ,  G06F9/542 ,  H04L67/1001 ,  G06F2209/5011

Abstract: Embodiments of the present disclosure may provide dynamic and fair assignment techniques for allocating resources on a demand basis. Assignment control may be separated into at least two components: a local component and a global component. Each component may have an active dialog with each other; the dialog may include two aspects: 1) a demand for computing resources, and 2) a total allowed number of computing resources. The global component may allocate resources from a pool of resources to different local components, and the local components in turn may assign their allocated resources to local competing requests. The allocation may also be throttled or limited at various levels.

公开(公告)号：US20240028592A1

公开(公告)日：2024-01-25

申请号：US18477808

申请日：2023-09-29

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/2453

CPC classification number: G06F16/24542 ,  G06F16/24537 ,  G06F16/24539

Abstract: Embodiments of the present disclosure may provide a dynamic query execution model. This query execution model may provide acceleration by scaling out parallel parts of a query (also referred to as a fragment) to additional computing resources, for example computing resources leased from a pool of computing resources. Execution of the parts of the query may be coordinated by a parent query coordinator, where the query originated, and a fragment query coordinator.