公开(公告)号：US11748327B2

公开(公告)日：2023-09-05

申请号：US17648622

申请日：2022-01-21

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo

IPC: G06F16/22 ,  G06F16/23 ,  G06F16/2455

CPC classification number: G06F16/2282 ,  G06F16/2358 ,  G06F16/24568

Abstract: A system or persistent table may be generated storing changelog information of a primary base table. The system table may then be used to create streams of relevant information. In some examples, the streams may read from the system table for information past a retention period of the primary table while reading from the primary table information in the retention period.

公开(公告)号：US20250124014A1

公开(公告)日：2025-04-17

申请号：US18987679

申请日：2024-12-19

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Fabian Hueske ,  Tyler Jones ,  Yevgeniy Kogan ,  Dzmitry Pauliukevich ,  Daniel E. Sotolongo

IPC: G06F16/23 ,  G06F16/22 ,  G06F16/2455

Abstract: Techniques described herein can accelerate change data capture determinations such as stream reads, which show changes made to a table between two points in time. Three distinct row bitsets that mark deleted, updated, inserted, rows in micro-partitions can be added as metadata for the table. These bitsets can be generated during DML operations and then stored as metadata of the new partition generated by the DML operations. The bitsets can then be used to generate streams showing the changes in the table between two points in time (changes interval).

公开(公告)号：US20250013624A1

公开(公告)日：2025-01-09

申请号：US18897249

申请日：2024-09-26

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo

IPC: G06F16/22 ,  G06F16/23 ,  G06F16/2455

Abstract: A system or persistent table may be generated storing changelog information of a primary base table. The system table may then be used to create streams of relevant information. In some examples, the streams may read from the system table for information past a retention period of the primary table while reading from the primary table information in the retention period.

公开(公告)号：US12182130B2

公开(公告)日：2024-12-31

申请号：US18324710

申请日：2023-05-26

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Thierry Cruanes ,  Istvan Cseri ,  Benoit Dageville ,  Tyler Jones ,  Dinesh Chandrakant Kulkarni

IPC: G06F16/245 ,  G06F16/2453 ,  G06F16/2455

Abstract: Hybrid tables can be used in different use-case scenarios. Hybrid tables provide a flexible mechanism to support files and data in different formats while providing access to the different types of data as part of one table. This flexibility can allow the use of hybrid tables in data lake or other similar environments.

公开(公告)号：US11762855B1

公开(公告)日：2023-09-19

申请号：US17931590

申请日：2022-09-13

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Fabian Hueske ,  Tyler Jones ,  Daniel Mills ,  Leon Papke ,  Prasanna Rajaperumal ,  Daniel E. Sotolongo

IPC: G06F16/2453 ,  G06F7/14

CPC classification number: G06F16/24539 ,  G06F7/14 ,  G06F16/24542

Abstract: Provided herein are systems and methods for a database object (e.g., materialized table) configuration including using the database object for incremental maintenance of query results. For example, a method includes creating a materialized table using a table definition. The table definition includes a query on one or more base tables and a lag duration value. The lag duration value indicates a maximum time period that a result of a prior refresh of the query can lag behind a current time instance. A delta set for the one or more base tables is determined. The delta set includes at least one change applied to the one or more base tables since the prior refresh of the query. The delta set is merged with the materialized table to perform an incremental update of the materialized table.

公开(公告)号：US11620310B1

公开(公告)日：2023-04-04

申请号：US17657497

申请日：2022-03-31

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Dinesh Chandrakant Kulkarni ,  Daniel Mills ,  Daniel E. Sotolongo ,  Di Fei Zhang

IPC: G06F16/00 ,  G06F16/27

Abstract: Techniques for triggering pipeline execution based on data change (transaction commit) are described. The pipelines can be used for data ingestion or other specified tasks. These tasks can be operational across account, organization, cloud region, and cloud provider boundaries. The tasks can be triggered by commit post-processing. Gates in the tasks can be set up to reference change data capture information. If the gate is satisfied, tasks can be executed to set up data pipelines.

公开(公告)号：US20220245117A1

公开(公告)日：2022-08-04

申请号：US17648622

申请日：2022-01-21

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo

IPC: G06F16/22 ,  G06F16/23 ,  G06F16/2455

Abstract: A system or persistent table may be generated storing changelog information of a primary base table. The system table may then be used to create streams of relevant information. In some examples, the streams may read from the system table for information past a retention period of the primary table while reading from the primary table information in the retention period.

公开(公告)号：US12216638B2

公开(公告)日：2025-02-04

申请号：US18158627

申请日：2023-01-24

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Fabian Hueske ,  Tyler Jones ,  Yevgeniy Kogan ,  Dzmitry Pauliukevich ,  Daniel E. Sotolongo

IPC: G06F16/23 ,  G06F16/22 ,  G06F16/2455

Abstract: Techniques described herein can accelerate change data capture determinations such as stream reads, which show changes made to a table between two points in time. Three distinct row bitests that mark deleted, updated, inserted, rows in micro-partitions can be added as metadata for the table. These bitsets can be generated during DML operations and then stored as metadata of the new partition generated by the DML operations. The bitsets can then be used to generate streams showing the changes in the table between two points in time (changes interval).

公开(公告)号：US12130795B2

公开(公告)日：2024-10-29

申请号：US18359322

申请日：2023-07-26

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo

IPC: G06F16/22 ,  G06F16/23 ,  G06F16/2455

CPC classification number: G06F16/2282 ,  G06F16/2358 ,  G06F16/24568

Abstract: A system or persistent table may be generated storing changelog information of a primary base table. The system table may then be used to create streams of relevant information. In some examples, the streams may read from the system table for information past a retention period of the primary table while reading from the primary table information in the retention period.

公开(公告)号：US11526517B2

公开(公告)日：2022-12-13

申请号：US17647500

申请日：2022-01-10

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo ,  Zhuo Zhang

IPC: G06F16/245 ,  G06F16/2455 ,  G06F16/2453

Abstract: A streaming ingest platform can improve latency and expense issues related to uploading data into a cloud data system. The streaming ingest platform can organize the data to be ingested into per-table chunks and per-account blobs. This data may be committed and may be made available for query processing before it is ingested into the target source tables. This significantly improves latency issues. The streaming ingest platform can also accommodate uploading data from various sources with different processing and communication capabilities, such as Internet of Things (IOT) devices.