公开(公告)号：US20250103593A1

公开(公告)日：2025-03-27

申请号：US18976635

申请日：2024-12-11

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Nicola Dan Onose ,  Jiaqi Yan

IPC: G06F16/2453 ,  G06F16/23

Abstract: A source table can be provided by a provider account in a data system. A secure view of the source table is provided to one or more consumer accounts, the secure view limiting access to a subset of data in the source table. A plan to execute a command using the secure view may be generated, the plan including a secure view boundary on a subset of operations defining the secure view. The plan may be modified to move a first operation that was outside the secure view boundary to within the secure view boundary to generate a second plan to optimize performance in view of limitations or restrictions placed by the secure view.

公开(公告)号：US12204541B2

公开(公告)日：2025-01-21

申请号：US18172688

申请日：2023-02-22

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Nicola Dan Onose ,  Jiaqi Yan

IPC: G06F16/2453 ,  G06F16/23

Abstract: A source table can be provided by a provider account in a data system. A secure view of the source table is provided to one or more consumer accounts, the secure view limiting access to a subset of data in the source table. A plan to execute a command using the secure view may be generated, the plan including a secure view boundary on a subset of operations defining the secure view. The plan may be modified to move a first operation that was outside the secure view boundary to within the secure view boundary to generate a second plan to optimize performance in view of limitations or restrictions placed by the secure view.

公开(公告)号：US20240427794A1

公开(公告)日：2024-12-26

申请号：US18513140

申请日：2023-11-17

Applicant: Snowflake Inc.

Inventor： Kavinder S. Dhaliwal ,  Bicheng Gao ,  Valeri Kim ,  Nithin Mahesh ,  Jiaqi Yan ,  Jiaqi Zhang

IPC: G06F16/25 ,  G06F16/22 ,  G06F16/245

Abstract: The subject technology provides techniques for enabling hidden database objects, which in an example are utilized for testing and verifying new database objects against existing workloads. Hidden database objects are a mechanism for bridging that gap by running user workloads on user data in advance of exposing the feature to users. This mechanism allows placing a database object as a hidden object nested beneath a user's visible object (e.g., table, column, view, and the like). Hidden database objects can be used to verify the functionality, parity, performance, and correctness of new unreleased features.

公开(公告)号：US20220405285A1

公开(公告)日：2022-12-22

申请号：US17822264

申请日：2022-08-25

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Srinivas Vemuri ,  Jiaqi Yan

IPC: G06F16/2455 ,  G06F11/34 ,  G06F16/248 ,  G06F16/22 ,  G06F16/2453

Abstract: The subject technology receives, during a query compilation process, a query directed to a set of source tables. The subject technology performs, during the query compilation process, a modification of the query for adjusting at least one pruning operation. The subject technology determines, during a pruning process of a second query, the second query directed to a set of files in a database system and including a set of pruning operations on the set of files, whether to perform a pruning cutoff on the set of pruning operations, the pruning process performing a depth first search of a pruner tree structure, the set of files comprising a set of micro-partitions. The subject technology performs the pruning cutoff based on the determining, the pruning cutoff ceasing at least one pruning operation from the set of pruning operations.

公开(公告)号：US20220138202A1

公开(公告)日：2022-05-05

申请号：US17540945

申请日：2021-12-02

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Srinivas Vemuri ,  Jiaqi Yan

IPC: G06F16/2455 ,  G06F11/34 ,  G06F16/248 ,  G06F16/22

Abstract: The subject technology receives, during a query compilation process, a query directed to a set of source tables, each source table from the set of source tables being organized into at least one micro-partition and the query including at least one pruning operation. The subject technology performs, during the query compilation process, a modification of the query for adjusting the at least one pruning operation, the modification being based at least in part on a set of statistics collected for previous pruning operations on at least a portion of the set of source tables and a set of heuristics. The subject technology compiles the query including the modification of the query. The subject technology provides the compiled query to an execution node of a database system for execution.

公开(公告)号：US11755581B2

公开(公告)日：2023-09-12

申请号：US17822264

申请日：2022-08-25

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Srinivas Vemuri ,  Jiaqi Yan

IPC: G06F16/2455 ,  G06F11/34 ,  G06F16/248 ,  G06F16/22 ,  G06F16/2453

CPC classification number: G06F16/24554 ,  G06F11/3409 ,  G06F16/2282 ,  G06F16/248 ,  G06F16/24534

Abstract: The subject technology receives, during a query compilation process, a query directed to a set of source tables. The subject technology performs, during the query compilation process, a modification of the query for adjusting at least one pruning operation. The subject technology determines, during a pruning process of a second query, the second query directed to a set of files in a database system and including a set of pruning operations on the set of files, whether to perform a pruning cutoff on the set of pruning operations, the pruning process performing a depth first search of a pruner tree structure, the set of files comprising a set of micro-partitions. The subject technology performs the pruning cutoff based on the determining, the pruning cutoff ceasing at least one pruning operation from the set of pruning operations.

公开(公告)号：US20220138196A1

公开(公告)日：2022-05-05

申请号：US17162979

申请日：2021-01-29

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Srinivas Vemuri ,  Jiaqi Yan

IPC: G06F16/2453

Abstract: During a query compilation process, a query is received that is directed to a set of source tables, each source table from the set of source tables being organized into at least one micro-partition and the query including at least one pruning operation. During the query compilation process, a modification of the query is performed for adjusting the at least one pruning operation, the modification being based on a set of statistics collected for previous pruning operations on at least a portion of the set of source tables and a set of heuristics, the set of statistics indicating at least an amount of execution time for each previous query associated with each of the previous pruning operations. The query is compiled including the modification of the query. The compiled query is provided to an execution node of a database system for execution.

公开(公告)号：US11222019B1

公开(公告)日：2022-01-11

申请号：US17165194

申请日：2021-02-02

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Srinivas Vemuri ,  Jiaqi Yan

IPC: G06F16/2455 ,  G06F11/34 ,  G06F16/248 ,  G06F16/22

Abstract: The subject technology receives, during a query compilation process, a query directed to a set of source tables, each source table from the set of source tables being organized into at least one micro-partition and the query including at least one pruning operation. The subject technology performs, during the query compilation process, a modification of the query for adjusting the at least one pruning operation, the modification being based at least in part on a set of statistics collected for previous pruning operations on at least a portion of the set of source tables and a set of heuristics. The subject technology compiles the query including the modification of the query. The subject technology provides the compiled query to an execution node of a database system for execution.

公开(公告)号：US12222954B2

公开(公告)日：2025-02-11

申请号：US18513140

申请日：2023-11-17

Applicant: Snowflake Inc.

Inventor： Kavinder S. Dhaliwal ,  Bicheng Gao ,  Valeri Kim ,  Nithin Mahesh ,  Jiaqi Yan ,  Jiaqi Zhang

IPC: G06F16/25 ,  G06F16/22 ,  G06F16/245

Abstract: The subject technology provides techniques for enabling hidden database objects, which in an example are utilized for testing and verifying new database objects against existing workloads. Hidden database objects are a mechanism for bridging that gap by running user workloads on user data in advance of exposing the feature to users. This mechanism allows placing a database object as a hidden object nested beneath a user's visible object (e.g., table, column, view, and the like). Hidden database objects can be used to verify the functionality, parity, performance, and correctness of new unreleased features.

公开(公告)号：US20230350893A1

公开(公告)日：2023-11-02

申请号：US18172688

申请日：2023-02-22

Applicant: Snowflake Inc.

Inventor： Bicheng Gao ,  Nicola Dan Onose ,  Jiaqi Yan

IPC: G06F16/2453 ,  G06F16/23

CPC classification number: G06F16/24544 ,  G06F16/2365

Abstract: A source table can be provided by a provider account in a data system. A secure view of the source table is provided to one or more consumer accounts, the secure view limiting access to a subset of data in the source table. A plan to execute a command using the secure view may be generated, the plan including a secure view boundary on a subset of operations defining the secure view. The plan may be modified to move a first operation that was outside the secure view boundary to within the secure view boundary to generate a second plan to optimize performance in view of limitations or restrictions placed by the secure view.