公开(公告)号：US11860850B2

公开(公告)日：2024-01-02

申请号：US18048912

申请日：2022-10-24

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Tyler Jones ,  Daniel Mills ,  Daniel E. Sotolongo

IPC: G06F16/23 ,  G06F16/2455 ,  G06F16/27 ,  G06F16/22

CPC classification number: G06F16/2358 ,  G06F16/2282 ,  G06F16/2456 ,  G06F16/24568 ,  G06F16/278

Abstract: Provided herein are systems and methods for a stream object configuration, including configuring and processing streams on views and streams on tables. For example, a method includes parsing, by at least one hardware processor, a received query to determine a plurality of data processing operations associated with a base table. A stream object on the base table is generated. The stream object includes a plurality of query results from executing the plurality of data processing operations and a corresponding plurality of time stamps of times the plurality of query results are obtained. A stream expansion of the stream object is performed. The stream expansion is based on computing changes to the base table from the plurality of data processing operations.

公开(公告)号：US20230092367A1

公开(公告)日：2023-03-23

申请号：US18048912

申请日：2022-10-24

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Tyler Jones ,  Daniel Mills ,  Daniel E. Sotolongo

IPC: G06F16/23 ,  G06F16/2455 ,  G06F16/27 ,  G06F16/22

Abstract: Provided herein are systems and methods for a stream object configuration, including configuring and processing streams on views and streams on tables. For example, a method includes parsing, by at least one hardware processor, a received query to determine a plurality of data processing operations associated with a base table. A stream object on the base table is generated. The stream object includes a plurality of query results from executing the plurality of data processing operations and a corresponding plurality of time stamps of times the plurality of query results are obtained. A stream expansion of the stream object is performed. The stream expansion is based on computing changes to the base table from the plurality of data processing operations.

公开(公告)号：US11593310B2

公开(公告)日：2023-02-28

申请号：US17821985

申请日：2022-08-24

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Tyler Jones

IPC: G06F16/17 ,  G06F16/182 ,  G06F16/18 ,  G06F11/14 ,  G06F16/14

Abstract: The subject technology determines, using a connection to an external data source, a set of shards stored in an external data source, the connection to the external data source being established using an external integration, the external integration including security and configuration information. The subject technology determines a set of offsets of each shard of the set of shards. The subject technology generates a query plan indicating a degree of parallelism based at least in part on a size of the set of offsets. The subject technology, based on the set of shards and the set of offsets, performs an operation on the external data source by performing, using the connection to the external data source, a write operation from a query statement on the external data source, the external data source being different than a storage platform associated with the system.

公开(公告)号：US11526517B2

公开(公告)日：2022-12-13

申请号：US17647500

申请日：2022-01-10

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo ,  Zhuo Zhang

IPC: G06F16/245 ,  G06F16/2455 ,  G06F16/2453

Abstract: A streaming ingest platform can improve latency and expense issues related to uploading data into a cloud data system. The streaming ingest platform can organize the data to be ingested into per-table chunks and per-account blobs. This data may be committed and may be made available for query processing before it is ingested into the target source tables. This significantly improves latency issues. The streaming ingest platform can also accommodate uploading data from various sources with different processing and communication capabilities, such as Internet of Things (IOT) devices.

公开(公告)号：US11516216B2

公开(公告)日：2022-11-29

申请号：US17241476

申请日：2021-04-27

Applicant: Snowflake Inc.

Inventor： Derek Denny-Brown ,  Tyler Jones ,  Isaac Kunen

IPC: H04L9/40 ,  G06F21/31

Abstract: A credentials store definition identifying a remote credential store is received. The credential store definition includes access information to enable access to the remote credentials store. A credentials object is created in an internal database based on a credentials object definition. The credentials object identifies a security credential to retrieve from the remote credentials store to access an external resource. At runtime, a request to access the external resource is received, and based on receiving the request, the security credentials identified by the credentials object are retrieved from the remote credential store using the access information. The retrieved security credential is provided to a processing component to access the external resource.

公开(公告)号：US20220327132A1

公开(公告)日：2022-10-13

申请号：US17647500

申请日：2022-01-10

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo ,  Zhuo Zhang

IPC: G06F16/2455 ,  G06F16/2453

Abstract: A streaming ingest platform can improve latency and expense issues related to uploading data into a cloud data system. The streaming ingest platform can organize the data to be ingested into per-table chunks and per-account blobs. This data may be committed and may be made available for query processing before it is ingested into the target source tables. This significantly improves latency issues. The streaming ingest platform can also accommodate uploading data from various sources with different processing and communication capabilities, such as Internet of Things (IOT) devices.

公开(公告)号：US11461274B2

公开(公告)日：2022-10-04

申请号：US17517398

申请日：2021-11-02

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Tyler Jones

IPC: G06F16/17 ,  G06F16/182 ,  G06F16/18 ,  G06F11/14 ,  G06F16/14

Abstract: The subject technology receives an operation to perform on an external data source accessible via a network, the external data source being hosted by an external system separate from a network-based database system. The subject technology determines a set of shards corresponding to the external data source. The subject technology determines a set of offsets of each shard of the set of shards. The subject technology, based on the set of shards and the set of offsets, performs the operation on the external data source. The subject technology provides an indication that the operation is complete.

公开(公告)号：US11321279B2

公开(公告)日：2022-05-03

申请号：US17219860

申请日：2021-03-31

Applicant: Snowflake Inc.

Inventor： Tyler Jones ,  Peter Povinec

IPC: G06F16/20 ,  G06F16/17 ,  G06F16/18 ,  H04L67/01 ,  G06F16/14 ,  H04L67/14

Abstract: In an embodiment, a database platform receives a request from a client for creation of an attachable-and-detachable database session, and responsively creates the requested attachable-and-detachable database session for the client. The database platform sets the attachable-and-detachable database session as a current database session for the client at the database platform. The database platform determines that the client has detached from the attachable-and-detachable database session, and thereafter continues to maintain the attachable-and-detachable database session in data storage at the database platform.

公开(公告)号：US11250006B1

公开(公告)日：2022-02-15

申请号：US17386258

申请日：2021-07-27

Applicant: Snowflake Inc.

Inventor： Tyler Arthur Akidau ,  Istvan Cseri ,  Tyler Jones ,  Daniel E. Sotolongo ,  Zhuo Zhang

IPC: G06F16/245 ,  G06F16/2455 ,  G06F16/2453

Abstract: A streaming ingest platform can improve latency and expense issues related to uploading data into a cloud data system. The streaming ingest platform can organize the data to be ingested into per-table chunks and per-account blobs. This data may be committed and may be made available for query processing before it is ingested into the target source tables. This significantly improves latency issues. The streaming ingest platform can also accommodate uploading data from various sources with different processing and communication capabilities, such as Internet of Things (IOT) devices.

公开(公告)号：US11216421B2

公开(公告)日：2022-01-04

申请号：US17345422

申请日：2021-06-11

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Tyler Jones ,  Dinesh Chandrakant Kulkarni ,  Igor Zinkovsky

IPC: G06F16/18 ,  G06F16/182 ,  G06F16/2453 ,  G06F16/2455 ,  G06F16/23

Abstract: The subject technology determines, using a stream object provided by a network-based database system separate from an external system, a set of offsets of each shard of a set of shards, the set of offsets being determined by executing a user defined function (UDF) included in the stream object, the stream object and the UDF being implemented in a particular programming language different than a database query language. The subject technology identifies an operation to perform on the set of shards. The subject technology, based on the set of shards and the set of offsets, performs, using the UDF included in the stream object, the operation on an external data source hosted by the external system. The subject technology increments a property indicating a different version of the stream object after performing the operation on the external data source, the property being included in the stream object.