-
公开(公告)号:US20250021556A1
公开(公告)日:2025-01-16
申请号:US18901289
申请日:2024-09-30
Applicant: Snowflake Inc.
Inventor: Xuelai Cui , Prashant Gaharwar , Vineet Garg , Boyung Lee , Kevin Ye Jie Li , Nicola Dan Onose , Andrew Z. Xue , Jiaqi Yan
IPC: G06F16/2453 , G06F11/34 , G06F16/2452
Abstract: The subject technology receives a query, the query including a statement for performing the query. The subject technology performs a first lookup operation on a multi-phase cache based on the query. The subject technology performs, in response to a first cache miss of the multi-phase cache, parsing of the statement from the query. The subject technology performs, based on the parsing, a compilation process on the query to generate a compiled query plan, the compilation process determining an optimization and a generalization for the query. The subject technology determines that the compiled query plan is cacheable. The subject technology registers, in response to the compiled query plan being cacheable, a dummy entry in the multi-phase cache.
-
公开(公告)号:US11921716B1
公开(公告)日:2024-03-05
申请号:US18453079
申请日:2023-08-21
Applicant: Snowflake Inc.
Inventor: Hossein Ahmandi , Jayanta Das , Joshua Klahr , Boyung Lee , Wenye Li , Abdul Q. Munir , Yi Pan
IPC: G06F16/00 , G06F16/2453 , G06F16/2455 , G06F16/27
CPC classification number: G06F16/24537 , G06F16/2456 , G06F16/278 , G06F16/24544
Abstract: A method includes parsing a query to determine a plurality of data processing operations associated with the query and including an AS OF JOIN operation between first time series data in a first table and second time series data in a second table. A query plan of the query is generated. The query plan includes a plurality of nodes corresponding to the plurality of data processing operations. At least one of the plurality of nodes corresponding to the AS OF JOIN operation is modified to generate a modified query plan of the query. The modifying is based on applying a UNION operation on at least a first portion of column data in the first table and the second table to obtain a combined table. Execution of the query by at least one of a plurality of computing nodes is scheduled based on the modified query plan.
-
公开(公告)号:US11544262B2
公开(公告)日:2023-01-03
申请号:US17538219
申请日:2021-11-30
Applicant: Snowflake Inc.
Inventor: Shrainik Jain , Allison Waingold Lee , Boyung Lee , Prasanna Rajaperumal , Jiaqi Yan , Yongsik Yoon
IPC: G06F16/2453
Abstract: Queries executed against a materialized view can execute up to orders of magnitude faster than equivalent queries on a source (or base) table. However, although a query can reference a materialized view directly, a user (e.g., query author) may not know about a relevant materialized view. Moreover, if a source table has multiple materialized views generated, the user may not know which materialized view to reference in the query. Thus, embodiments of the present disclosure provide techniques for automatically rewriting queries directed to a source table to utilize existing materialized views.
-
公开(公告)号:US20240362222A1
公开(公告)日:2024-10-31
申请号:US18309490
申请日:2023-04-28
Applicant: Snowflake Inc.
Inventor: Xuelai Cui , Prashant Gaharwar , Vineet Garg , Boyung Lee , Kevin Ye Jie Li , Nicola Dan Onose , Andrew Xue , Jiaqi Yan
IPC: G06F16/2453 , G06F11/34 , G06F16/2452
CPC classification number: G06F16/24542 , G06F11/3409 , G06F16/24528 , G06F16/24539
Abstract: The subject technology receives a query, the query including a statement for performing the query. The subject technology performs a first lookup operation on a multi-phase cache based on the query. The subject technology performs, in response to a first cache miss of the multi-phase cache, parsing of the statement from the query. The subject technology performs, based on the parsing, a compilation process on the query to generate a compiled query plan, the compilation process determining an optimization and a generalization for the query. The subject technology determines that the compiled query plan is cacheable. The subject technology registers, in response to the compiled query plan being cacheable, a dummy entry in the multi-phase cache.
-
公开(公告)号:US20220092068A1
公开(公告)日:2022-03-24
申请号:US17538219
申请日:2021-11-30
Applicant: Snowflake Inc.
Inventor: Shrainik Jain , Allison Waingold Lee , Boyung Lee , Prasanna Rajaperumal , Jiaqi Yan , Yongsik Yoon
IPC: G06F16/2453
Abstract: Queries executed against a materialized view can execute up to orders of magnitude faster than equivalent queries on a source (or base) table. However, although a query can reference a materialized view directly, a user (e.g., query author) may not know about a relevant materialized view. Moreover, if a source table has multiple materialized views generated, the user may not know which materialized view to reference in the query. Thus, embodiments of the present disclosure provide techniques for automatically rewriting queries directed to a source table to utilize existing materialized views.
-
公开(公告)号:US11216462B1
公开(公告)日:2022-01-04
申请号:US16994024
申请日:2020-08-14
Applicant: Snowflake Inc.
Inventor: Shrainik Jain , Allison Waingold Lee , Boyung Lee , Prasanna Rajaperumal , Jiaqi Yan , Yongsik Yoon
IPC: G06F16/2453
Abstract: Queries executed against a materialized view can execute up to orders of magnitude faster than equivalent queries on a source (or base) table. However, although a query can reference a materialized view directly, a user (e.g., query author) may not know about a relevant materialized view. Moreover, if a source table has multiple materialized views generated, the user may not know which materialized view to reference in the query. Thus, embodiments of the present disclosure provide techniques for automatically rewriting queries directed to a source table to utilize existing materialized views.
-
公开(公告)号:US20250068628A1
公开(公告)日:2025-02-27
申请号:US18392385
申请日:2023-12-21
Applicant: Snowflake Inc.
Inventor: Hossein Ahmandi , Jayanta Das , Joshua Klahr , Boyung Lee , Wenye Li , Abdul Q. Munir , Yi Pan
IPC: G06F16/2453 , G06F16/2455 , G06F16/27
Abstract: A method includes generating, by at least one hardware processor, a query plan of a query. The query includes a JOIN operation between first time series data and second time series data. At least one node in the query plan corresponding to the JOIN operation is modified to generate a modified query plan. The modifying is based on replacing the at least one node with a new node including a UNION operation. The UNION operation is based on the first time series data and the second time series data. Execution of the query is scheduled based on the modified query plan.
-
公开(公告)号:US12135715B1
公开(公告)日:2024-11-05
申请号:US18309490
申请日:2023-04-28
Applicant: Snowflake Inc.
Inventor: Xuelai Cui , Prashant Gaharwar , Vineet Garg , Boyung Lee , Kevin Ye Jie Li , Nicola Dan Onose , Andrew Xue , Jiaqi Yan
IPC: G06F16/30 , G06F11/34 , G06F16/2452 , G06F16/2453
Abstract: The subject technology receives a query, the query including a statement for performing the query. The subject technology performs a first lookup operation on a multi-phase cache based on the query. The subject technology performs, in response to a first cache miss of the multi-phase cache, parsing of the statement from the query. The subject technology performs, based on the parsing, a compilation process on the query to generate a compiled query plan, the compilation process determining an optimization and a generalization for the query. The subject technology determines that the compiled query plan is cacheable. The subject technology registers, in response to the compiled query plan being cacheable, a dummy entry in the multi-phase cache.
-
公开(公告)号:US12026159B2
公开(公告)日:2024-07-02
申请号:US18059125
申请日:2022-11-28
Applicant: Snowflake Inc.
Inventor: Shrainik Jain , Allison Waingold Lee , Boyung Lee , Prasanna Rajaperumal , Jiaqi Yan , Yongsik Yoon
IPC: G06F16/2453
CPC classification number: G06F16/24542
Abstract: Queries executed against a materialized view can execute up to orders of magnitude faster than equivalent queries on a source (or base) table. However, although a query can reference a materialized view directly, a user (e.g., query author) may not know about a relevant materialized view. Moreover, if a source table has multiple materialized views generated, the user may not know which materialized view to reference in the query. Thus, embodiments of the present disclosure provide techniques for automatically rewriting queries directed to a source table to utilize existing materialized views.
-
公开(公告)号:US12026160B2
公开(公告)日:2024-07-02
申请号:US18300778
申请日:2023-04-14
Applicant: Snowflake Inc.
Inventor: Thierry Cruanes , Xuelai Cui , Sangyong Hwang , Allison Waingold Lee , Boyung Lee , Nicola Dan Onose , William Waddington , Jiaqi Yan , Li Yan , Yongsik Yoon
IPC: G06F16/2453
CPC classification number: G06F16/24542 , G06F16/24539
Abstract: The subject technology receives a query, the query including a set of statements for performing the query. The subject technology populates a compilation context based at least in part the query. The subject technology invokes a compiler to perform a compilation process based on the compilation context. The subject technology performs a lookup operation on a stored plan cache for an exact match based on information from the compilation context. The subject technology, in response to determining an exact match, determines whether the particular query plan requires re-compilation based on a data dependent optimization. The subject technology determines whether a plan cache entry corresponding to the particular query plan includes a data property constraint. The subject technology determines whether the data property constraint still holds based on a set of data properties.
-
-
-
-
-
-
-
-
-