公开(公告)号：US20230418807A1

公开(公告)日：2023-12-28

申请号：US18459256

申请日：2023-08-31

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Tyler Jones ,  Daniel Mills ,  Daniel E. Sotolongo

IPC: G06F16/23 ,  G06F16/2455 ,  G06F16/27 ,  G06F16/22

CPC classification number: G06F16/2358 ,  G06F16/24568 ,  G06F16/278 ,  G06F16/2456 ,  G06F16/2282

Abstract: Provided herein are systems and methods for a stream object configuration, including query processing of stream objects using stream expansion. For example, a method includes decoding a query to obtain a first data processing operation and a first stream object. The first stream object is associated with a view on a base table. A first stream expansion on the first stream object is performed. The first stream expansion is based on generating a second stream object on the base table. A second stream expansion of the second stream object is performed. The second stream expansion is based on replacing the second stream object with at least a second data processing operation. The query is executed based on completing the first data processing operation and the at least a second data processing operation.

公开(公告)号：US20230409574A1

公开(公告)日：2023-12-21

申请号：US18362898

申请日：2023-07-31

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Fabian Hueske ,  Tyler Jones ,  Daniel Mills ,  Leon Papke ,  Prasanna Rajaperumal ,  Daniel E. Sotolongo

IPC: G06F16/2453 ,  G06F7/14

CPC classification number: G06F16/24539 ,  G06F7/14 ,  G06F16/24542

Abstract: A system for a materialized table (MT) refresh using multiple processing pipelines includes at least one hardware processor coupled to memory storing instructions. The instructions cause the at least one hardware processor to perform operations including determining dependencies among a plurality of intermediate MTs generated from a source MT. The source MT uses a table definition with a query on one or more base tables and a lag duration value. A graph snapshot of dependencies among the plurality of intermediate MTs is generated. Processing pipelines are configured. Each of the processing pipelines corresponds to a subset of the plurality of intermediate MTs indicated by the graph snapshot. Responsive to detecting an instruction for a refresh operation on the source MT, refreshes on corresponding intermediate MTs of the plurality of intermediate MTs in each processing pipeline of the processing pipelines are performed to complete the refresh operation on the source MT.

公开(公告)号：US11755568B1

公开(公告)日：2023-09-12

申请号：US17931705

申请日：2022-09-13

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Tyler Jones ,  Daniel Mills ,  Leon Papke ,  Prasanna Rajaperumal ,  Daniel E. Sotolongo

IPC: G06F16/23 ,  G06F11/34

CPC classification number: G06F16/2393 ,  G06F11/3419

Abstract: Provided herein are systems and methods for a database object (e.g., materialized table) configuration including scheduling refreshes of the materialized table. For example, a method includes determining a dependency graph for a first MT. The dependency graph comprises a second MT from which the first MT depends. The first MT includes a query on one or more base tables and a lag duration value. The lag duration value indicates a maximum time period that a result of a prior refresh of the query can lag behind a current time instance. A tick period is selected for a set of ticks based on the lag duration value. The set of ticks corresponds to a set of aligned time instances. Refresh operations are scheduled for the first and second MTs at corresponding time instances from the set of aligned time instances. The corresponding time instances are separated by the tick period.