公开(公告)号：US12050582B1

公开(公告)日：2024-07-30

申请号：US18498463

申请日：2023-10-31

Applicant: Snowflake Inc.

Inventor： Selcuk Aya ,  Thierry Cruanes ,  Istvan Cseri ,  Benoit Dageville ,  Marcia Feitel ,  Steven P. Herbert ,  Dennis Huo ,  Xinglian Liu ,  Nithin Mahesh ,  James Malone ,  Subramanian Muralidhar ,  Muthunagappan Muthuraman ,  Ronald Lee Ortloff ,  Polita Paulus ,  Marianne Shaw ,  Nileema Shingte ,  Wai Sing Wong ,  Jiaqi Yan

IPC: G06F16/22 ,  G06F16/215 ,  G06F16/2457

CPC classification number: G06F16/2282 ,  G06F16/215 ,  G06F16/24573

Abstract: The subject technology provides embodiments for supporting a unified table which may be a managed table or an unmanaged table. Managed tables are those where the subject technology manages the metastore/catalog for the table, whereas unmanaged tables are tables where an external catalog controls the table and the subject technology integrates with that catalog to work with the table, but does not assume control of the table.

公开(公告)号：US11914602B2

公开(公告)日：2024-02-27

申请号：US18050255

申请日：2022-10-27

Applicant: Snowflake Inc.

Inventor： Jeffrey Rosen ,  Abdul Munir ,  Jiaqi Yan ,  William Waddington ,  Prasanna Rajaperumal ,  Thierry Cruanes

IPC: G06F16/24 ,  G06F16/2458 ,  G06F16/2453 ,  G06F9/50 ,  G06F16/2455

CPC classification number: G06F16/2465 ,  G06F9/505 ,  G06F9/5077 ,  G06F16/24535 ,  G06F16/24542 ,  G06F16/24565

Abstract: Resource provisioning systems and methods are described. In an embodiment, a system includes a plurality of shared storage devices collectively storing database data, an execution platform, and a compute service manager. The compute service manager is configured to determine a task to be executed in response to a trigger event and determine a query plan for executing the task, wherein the query plan comprises a plurality of discrete subtasks. The compute service manager is further configured to assign the plurality of discrete subtasks to one or more nodes of a plurality of nodes of the execution platform, determine whether execution of the task is complete, and in response to determining the execution of the task is complete, store a record in the plurality of shared storage devices indicating the task was completed.

公开(公告)号：US20230401180A1

公开(公告)日：2023-12-14

申请号：US18345987

申请日：2023-06-30

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Benoit Dageville ,  Ganeshan Ramachandran Iyer ,  Yucan Liu ,  Jiaqi Yan

IPC: G06F16/21

CPC classification number: G06F16/211

Abstract: Techniques for schema mismatch detection and evolution are described. When data is being uploaded into a source table, schema of the data to be uploaded can be compared with the schema for the source table. If a schema mismatch is detected, the schema of the source table can be modified, and the upload can be continued without data loss.

公开(公告)号：US20230229676A1

公开(公告)日：2023-07-20

申请号：US17896446

申请日：2022-08-26

Applicant: SNOWFLAKE INC.

Inventor： Yi Fang ,  Varun Ganesh ,  Xinglian Liu ,  Ryan Michael Thomas Shelly ,  Jiaqi Yan ,  Yizhi Zhu

IPC: G06F16/28

CPC classification number: G06F16/285

Abstract: Embodiments of the present disclosure describe systems, methods, and computer program products for improving query processing of a database. An example method can include: storing table data for a table in a plurality of micro-partitions, each micro-partition comprising a portion of the table data for the table; for each micro-partition of the plurality of micro-partitions, storing metadata for the micro-partition in at least one of a plurality of expression properties; and selecting, by a processing device, a subset of the plurality of expression properties to be grouped into a grouping expression property based at least partially on the metadata of the subset of the plurality of the expression properties. The grouping expression property may include cumulative metadata associated with the metadata of the subset of the plurality of expression properties.

公开(公告)号：US11687373B2

公开(公告)日：2023-06-27

申请号：US18050608

申请日：2022-10-28

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F9/46 ,  G06F9/50 ,  G06F9/54 ,  H04L67/1001

CPC classification number: G06F9/5027 ,  G06F9/5077 ,  G06F9/5083 ,  G06F9/542 ,  H04L67/1001 ,  G06F2209/5011

Abstract: Embodiments of the present disclosure may provide dynamic and fair assignment techniques for allocating resources on a demand basis. Assignment control may be separated into at least two components: a local component and a global component. Each component may have an active dialog with each other; the dialog may include two aspects: 1) a demand for computing resources, and 2) a total allowed number of computing resources. The global component may allocate resources from a pool of resources to different local components, and the local components in turn may assign their allocated resources to local competing requests. The allocation may also be throttled or limited at various levels.

公开(公告)号：US20230079405A1

公开(公告)日：2023-03-16

申请号：US18050608

申请日：2022-10-28

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F9/50 ,  G06F9/54 ,  H04L67/1001

Abstract: Embodiments of the present disclosure may provide dynamic and fair assignment techniques for allocating resources on a demand basis. Assignment control may be separated into at least two components: a local component and a global component. Each component may have an active dialog with each other; the dialog may include two aspects: 1) a demand for computing resources, and 2) a total allowed number of computing resources. The global component may allocate resources from a pool of resources to different local components, and the local components in turn may assign their allocated resources to local competing requests. The allocation may also be throttled or limited at various levels.

公开(公告)号：US11544262B2

公开(公告)日：2023-01-03

申请号：US17538219

申请日：2021-11-30

Applicant: Snowflake Inc.

Inventor： Shrainik Jain ,  Allison Waingold Lee ,  Boyung Lee ,  Prasanna Rajaperumal ,  Jiaqi Yan ,  Yongsik Yoon

IPC: G06F16/2453

Abstract: Queries executed against a materialized view can execute up to orders of magnitude faster than equivalent queries on a source (or base) table. However, although a query can reference a materialized view directly, a user (e.g., query author) may not know about a relevant materialized view. Moreover, if a source table has multiple materialized views generated, the user may not know which materialized view to reference in the query. Thus, embodiments of the present disclosure provide techniques for automatically rewriting queries directed to a source table to utilize existing materialized views.

公开(公告)号：US11513859B2

公开(公告)日：2022-11-29

申请号：US17342713

申请日：2021-06-09

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F9/46 ,  G06F9/50 ,  G06F9/54 ,  H04L67/1001

Abstract: Embodiments of the present disclosure may provide dynamic and fair assignment techniques for allocating resources on a demand basis. Assignment control may be separated into at least two components: a local component and a global component. Each component may have an active dialog with each other; the dialog may include two aspects: 1) a demand for computing resources, and 2) a total allowed number of computing resources. The global component may allocate resources from a pool of resources to different local components, and the local components in turn may assign their allocated resources to local competing requests. The allocation may also be throttled or limited at various levels.

公开(公告)号：US11461326B2

公开(公告)日：2022-10-04

申请号：US17657257

申请日：2022-03-30

Applicant: Snowflake Inc.

Inventor： Thierry Cruanes ,  Igor Demura ,  Varun Ganesh ,  Prasanna Rajaperumal ,  Libo Wang ,  Jiaqi Yan

IPC: G06F16/2453

Abstract: Embodiments of the present disclosure may provide a dynamic query execution model. This query execution model may provide acceleration by scaling out parallel parts of a query (also referred to as a fragment) to additional computing resources, for example computing resources leased from a pool of computing resources. Execution of the parts of the query may be coordinated by a parent query coordinator, where the query originated, and a fragment query coordinator.

公开(公告)号：US11416463B1

公开(公告)日：2022-08-16

申请号：US17721938

申请日：2022-04-15

Applicant: Snowflake Inc.

Inventor： Jiaqi Yan ,  Qiuye Jin ,  Shrainik Jain ,  Stratis Viglas ,  Allison Lee

IPC: G06F16/21 ,  G06F11/34 ,  G06F16/2453 ,  G06F16/215 ,  G06F11/30 ,  G06F11/07

Abstract: Systems, methods, and devices for incremental feature development and workload capture in database systems are disclosed. The method includes determining a workload based on one or more client queries to be rerun for testing the feature release. The method further includes repeatedly executing a test run of the workload to identify whether there is a performance difference in the test run. The method further includes re-execute, in response to identifying the performance difference, the test run using resources with a different concurrency to identify whether the performance difference still exists. The method further includes flagging the performance difference as a false positive in response to identifying that the performance difference no longer exists when the test run is re-executed using the resources with different concurrency.