公开(公告)号：US11526517B2

公开(公告)日：2022-12-13

申请号：US17647500

申请日：2022-01-10

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo ,  Zhuo Zhang

IPC: G06F16/245 ,  G06F16/2455 ,  G06F16/2453

Abstract: A streaming ingest platform can improve latency and expense issues related to uploading data into a cloud data system. The streaming ingest platform can organize the data to be ingested into per-table chunks and per-account blobs. This data may be committed and may be made available for query processing before it is ingested into the target source tables. This significantly improves latency issues. The streaming ingest platform can also accommodate uploading data from various sources with different processing and communication capabilities, such as Internet of Things (IOT) devices.

公开(公告)号：US20220327132A1

公开(公告)日：2022-10-13

申请号：US17647500

申请日：2022-01-10

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo ,  Zhuo Zhang

IPC: G06F16/2455 ,  G06F16/2453

Abstract: A streaming ingest platform can improve latency and expense issues related to uploading data into a cloud data system. The streaming ingest platform can organize the data to be ingested into per-table chunks and per-account blobs. This data may be committed and may be made available for query processing before it is ingested into the target source tables. This significantly improves latency issues. The streaming ingest platform can also accommodate uploading data from various sources with different processing and communication capabilities, such as Internet of Things (IOT) devices.

公开(公告)号：US11250006B1

公开(公告)日：2022-02-15

申请号：US17386258

申请日：2021-07-27

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo ,  Zhuo Zhang

IPC: G06F16/245 ,  G06F16/2455 ,  G06F16/2453

Abstract: A streaming ingest platform can improve latency and expense issues related to uploading data into a cloud data system. The streaming ingest platform can organize the data to be ingested into per-table chunks and per-account blobs. This data may be committed and may be made available for query processing before it is ingested into the target source tables. This significantly improves latency issues. The streaming ingest platform can also accommodate uploading data from various sources with different processing and communication capabilities, such as Internet of Things (IOT) devices.

公开(公告)号：US11100111B1

公开(公告)日：2021-08-24

申请号：US17226423

申请日：2021-04-09

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo ,  Zhuo Zhang

IPC: G06F16/245 ,  G06F16/2455 ,  G06F16/2453

Abstract: A streaming ingest platform can improve latency and expense issues related to uploading data into a cloud data system. The streaming ingest platform can organize the data to be ingested into per-table chunks and per-account blobs. This data may be committed and may be made available for query processing before it is ingested into the target source tables. This significantly improves latency issues. The streaming ingest platform can also accommodate uploading data from various sources with different processing and communication capabilities, such as Internet of Things (IOT) devices.

公开(公告)号：US12235874B2

公开(公告)日：2025-02-25

申请号：US18610863

申请日：2024-03-20

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Dinesh Chandrakant Kulkarni ,  Daniel Mills ,  Daniel E. Sotolongo ,  Di Fei Zhang

IPC: G06F16/00 ,  G06F16/27

Abstract: Techniques for triggering pipeline execution based on data change (transaction commit) are described. The pipelines can be used for data ingestion or other specified tasks. These tasks can be operational across account, organization, cloud region, and cloud provider boundaries. The tasks can be triggered by commit post-processing. Gates in the tasks can be set up to reference change data capture information. If the gate is satisfied, tasks can be executed to set up data pipelines.

公开(公告)号：US12222958B2

公开(公告)日：2025-02-11

申请号：US18345949

申请日：2023-06-30

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo ,  Boyuan Zhang

IPC: G06F16/30 ,  G06F16/27

Abstract: Techniques described herein can enable stream replication. A first deployment can store a table including one or more streams. The techniques described herein can be used to replicate the table at a second deployment while replicating the one or more streams associated with the table. Select prior table versions and partitions in the table are copied to the second deployment to enable stream replication.

公开(公告)号：US12182099B2

公开(公告)日：2024-12-31

申请号：US18426772

申请日：2024-01-30

Applicant: Snowflake Inc.

Inventor： Abdullah Al Mahmood ,  Tyler Jones ,  Xin Huang ,  Ganeshan Ramachandran Iyer ,  Jiaxing Liang ,  Daniel Mills ,  Subramanian Muralidhar ,  Daniel E. Sotolongo

IPC: G06F16/23 ,  G06F11/14 ,  G06F16/22

Abstract: Techniques for creating and using error tables to track errors associated with a base table are described. A command to perform an operation on a base table stored in a network-based data system can be received and executed, causing at least one error. At least one error record corresponding to the at least one error can be inputted into an error table, which is nested with the base table. Contextual information can be added to the at least one error record.

公开(公告)号：US11966416B2

公开(公告)日：2024-04-23

申请号：US18103977

申请日：2023-01-31

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Dinesh Chandrakant Kulkarni ,  Daniel Mills ,  Daniel E. Sotolongo ,  Di Fei Zhang

IPC: G06F16/00 ,  G06F16/27

CPC classification number: G06F16/273

Abstract: Techniques for triggering pipeline execution based on data change (transaction commit) are described. The pipelines can be used for data ingestion or other specified tasks. These tasks can be operational across account, organization, cloud region, and cloud provider boundaries. The tasks can be triggered by commit post-processing. Gates in the tasks can be set up to reference change data capture information. If the gate is satisfied, tasks can be executed to set up data pipelines.

公开(公告)号：US11921700B1

公开(公告)日：2024-03-05

申请号：US18319886

申请日：2023-05-18

Applicant: Snowflake Inc.

Inventor： Abdullah Al Mahmood ,  Tyler Jones ,  Xin Huang ,  Ganeshan Ramachandran Iyer ,  Jiaxing Liang ,  Daniel Mills ,  Subramanian Muralidhar ,  Daniel E. Sotolongo

IPC: G06F16/23 ,  G06F11/14 ,  G06F16/22

CPC classification number: G06F16/2365 ,  G06F11/1469 ,  G06F16/2282 ,  G06F2201/80

Abstract: Techniques for creating and using error tables to track errors associated with a base table are described. A command to perform an operation on a base table stored in a network-based data system can be received and executed, causing at least one error. At least one error record corresponding to the at least one error can be inputted into an error table, which is nested with the base table. Contextual information can be added to the at least one error record.

公开(公告)号：US20230418807A1

公开(公告)日：2023-12-28

申请号：US18459256

申请日：2023-08-31

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Tyler Jones ,  Daniel Mills ,  Daniel E. Sotolongo

IPC: G06F16/23 ,  G06F16/2455 ,  G06F16/27 ,  G06F16/22

CPC classification number: G06F16/2358 ,  G06F16/24568 ,  G06F16/278 ,  G06F16/2456 ,  G06F16/2282

Abstract: Provided herein are systems and methods for a stream object configuration, including query processing of stream objects using stream expansion. For example, a method includes decoding a query to obtain a first data processing operation and a first stream object. The first stream object is associated with a view on a base table. A first stream expansion on the first stream object is performed. The first stream expansion is based on generating a second stream object on the base table. A second stream expansion of the second stream object is performed. The second stream expansion is based on replacing the second stream object with at least a second data processing operation. The query is executed based on completing the first data processing operation and the at least a second data processing operation.