公开(公告)号：US12204547B2

公开(公告)日：2025-01-21

申请号：US18471001

申请日：2023-09-20

Applicant: Snowflake Inc.

Inventor： Elliott Brossard ,  Srilakshmi Chintala ,  Istvan Cseri ,  Rodger N. Kline ,  Nitya Kumar Sharma ,  Igor Zinkovsky

IPC: G06F16/30 ,  G06F16/2455 ,  G06F16/25 ,  G06F16/27

Abstract: An external function system can be implemented on a database to perform processing on one or more external network services. The external function system can comprise a particular external function for a particular external service, an outbound serializer function, and an inbound serializer function that are linked with the particular external function. The outbound serializer function can be configured to transform the data of a query from a database format to a different format of the particular external network service. The inbound deserializer function can be configured to receive data returned from the external service and transform the data to the format of the database.

公开(公告)号：US11928110B2

公开(公告)日：2024-03-12

申请号：US18051483

申请日：2022-10-31

Applicant: Snowflake Inc.

Inventor： Srilakshmi Chintala ,  Chong Han ,  Albert L. Hu ,  Nitya Kumar Sharma ,  Igor Zinkovsky

IPC: G06F16/00 ,  G06F16/242 ,  G06F16/248 ,  G06F16/27 ,  G06F8/41

CPC classification number: G06F16/2448 ,  G06F16/248 ,  G06F16/27 ,  G06F8/433

Abstract: A database dependency resolver system can identify different dependencies of a user application and integrate the identified dependencies in different execution environments of a distributed database system. The different execution environments can manage different versions of a given programming language, or other types of computational architectures (e.g., different CPU types). A database user can provide a database statement (e.g., query) that activates the different dependencies in the different environments to generate results data.

公开(公告)号：US11423081B1

公开(公告)日：2022-08-23

申请号：US17390969

申请日：2021-08-01

Applicant: Snowflake Inc.

Inventor： Elliott Brossard ,  Sukruth Komarla Sukumar ,  Isaac Kunen ,  Ju-Yi Kuo ,  Jonathan Leang ,  Edward Ma ,  Schuyler James Manchester ,  Polita Paulus ,  Saurin Shah ,  Igor Zinkovsky

IPC: G06F16/00 ,  G06F16/901 ,  G06F16/955 ,  G06F16/2455 ,  G06F16/22 ,  G06F16/908

Abstract: A file access system for user defined functions (UDFs) can be implemented on a distributed database system. The system can store UDF signatures and interfaces (e.g., classes, sub-classes) that can be called by other users. Upon a UDF being called, one or more interface objects (e.g., InputStream) can be created and requests transferred to a execution node via a network channel. The execution node can implement multiple threads that are authorized and download file data from a staging location (e.g., internal stage, external stage) concurrently.

公开(公告)号：US20220237231A1

公开(公告)日：2022-07-28

申请号：US17657548

申请日：2022-03-31

Applicant: Snowflake Inc.

Inventor： Elliott Brossard ,  Sukruth Komarla Sukumar ,  Isaac Kunen ,  Ju-yi Kuo ,  Jonathan Lee Leang ,  Edward Ma ,  Schuyler James Manchester ,  Polita Paulus ,  Saurin Shah ,  Igor Zinkovsky

IPC: G06F16/901 ,  G06F16/955 ,  G06F16/2455 ,  G06F16/22 ,  G06F16/908

Abstract: A file access system for user defined functions (UDFs) can be implemented on a distributed database system. The system can store UDF interfaces and file reference objects that can be called by other users. Upon a UDF being called, files on a stage, one or more interface objects (e.g., InputStream), and file reference objects can be implemented by execution nodes of the distributed database system. The execution nodes can implement multiple threads that are authenticated and can download file data from a staging location concurrently.

公开(公告)号：US20210390007A1

公开(公告)日：2021-12-16

申请号：US17461576

申请日：2021-08-30

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Isaac Kunen ,  Igor Zinkovsky

IPC: G06F9/54 ,  H04L29/08 ,  H04L29/06 ,  G06F16/242

Abstract: A query referencing a function associated with a remote software component is received by a network-based data warehouse system. Temporary security credentials corresponding to a role at a cloud computing service platform are obtained. The role has permission to send calls to a web endpoint corresponding to the remote software component. A request comprising input data and electronically signed using the temporary security credentials is sent to a web Application Programming Interface (API) management system of the cloud computing service platform. The request, when received by the web API management system, causes the web API management system to invoke external functionality provided by the remote software component at the web endpoint with respect to the input data. A response comprising a result of invoking the external functionality is received from the web API management system, and the result data is processed according to the query.

公开(公告)号：US20210318994A1

公开(公告)日：2021-10-14

申请号：US17345422

申请日：2021-06-11

Applicant: Snowflake Inc.

Inventor： Istvan Cseri ,  Tyler Jones ,  Dinesh Chandrakant Kulkarni ,  Igor Zinkovsky

IPC: G06F16/18 ,  G06F16/182 ,  G06F16/2453 ,  G06F16/2455 ,  G06F16/23

Abstract: The subject technology determines, using a stream object provided by a network-based database system separate from an external system, a set of offsets of each shard of a set of shards, the set of offsets being determined by executing a user defined function (UDF) included in the stream object, the stream object and the UDF being implemented in a particular programming language different than a database query language. The subject technology identifies an operation to perform on the set of shards. The subject technology, based on the set of shards and the set of offsets, performs, using the UDF included in the stream object, the operation on an external data source hosted by the external system. The subject technology increments a property indicating a different version of the stream object after performing the operation on the external data source, the property being included in the stream object.

公开(公告)号：US12242475B2

公开(公告)日：2025-03-04

申请号：US17039473

申请日：2020-09-30

Applicant: Snowflake Inc.

Inventor： Elliott Brossard ,  Istvan Cseri ,  Isaac Kunen ,  Nitya Kumar Sharma ,  Igor Zinkovsky

IPC: G06F16/2453

Abstract: External functions can provide users of a database system the ability to invoke external services while operating from inside the database system. The techniques described herein address may detect throttling by the external system and automatically adjust or modify a request rate accordingly. Also, the techniques described herein may increase the request rate to optimize the use of the resources provided by the external system. These techniques allow the database system to improve efficiency when working with external services, which may or may not be elastic or scalable. Moreover, these techniques can decrease query execution times and reduce costs.

公开(公告)号：US11803552B2

公开(公告)日：2023-10-31

申请号：US17813548

申请日：2022-07-19

Applicant: Snowflake Inc.

Inventor： Elliott Brossard ,  Srilakshmi Chintala ,  Istvan Cseri ,  Rodger N. Kline ,  Nitya Kumar Sharma ,  Igor Zinkovsky

IPC: G06F16/30 ,  G06F16/2455 ,  G06F16/25 ,  G06F16/27

CPC classification number: G06F16/24564 ,  G06F16/258 ,  G06F16/27

Abstract: An external function system can be implemented on a database to perform processing on one or more external network services. The external function system can comprise a particular external function for a particular external service, an outbound serializer function, and an inbound serializer function that are linked with the particular external function. The outbound serializer function can be configured to transform the data of a query from a database format to a different format of the particular external network service. The inbound deserializer function can be configured to receive data returned from the external service and transform the data to the format of the database.

公开(公告)号：US20230315693A1

公开(公告)日：2023-10-05

申请号：US17657229

申请日：2022-03-30

Applicant: Snowflake Inc.

Inventor： Selcuk Aya ,  Ju-yi Kuo ,  Jonathan Lee Leang ,  Nitya Kumar Sharma ,  Igor Zinkovsky

IPC: G06F16/176 ,  G06F16/172 ,  G06F16/17

CPC classification number: G06F16/1774 ,  G06F16/172 ,  G06F16/1734

Abstract: Systems and methods for caching file system collections atomically. The systems and methods perform operations comprising: receiving a request to access a collection of data comprising a plurality of files stored on a storage device; in response to receiving the request, transferring the collection of data from the storage device to a first subfolder in a cache associated with the storage device; generating a lock file comprising a reference to the first subfolder in the cache; and atomically controlling access to the collection of data in the first subfolder and removal of the collection of data in the first subfolder from the cache via the lock file.

公开(公告)号：US11762978B1

公开(公告)日：2023-09-19

申请号：US18194407

申请日：2023-03-31

Applicant: Snowflake Inc.

Inventor： Srilakshmi Chintala ,  Albert L. Hu ,  Ziliang Zhang ,  Igor Zinkovsky

IPC: H04L29/06 ,  G06F21/44 ,  G06F21/53

CPC classification number: G06F21/44 ,  G06F21/53 ,  G06F2221/2141

Abstract: Methods, systems, and computer programs are presented for a packages policy object to enable customers to create and apply packages policies provided by third-party package managers. A user-defined function (UDF) is received by a cloud data platform. The UDF includes code related to at least one operation to be performed. The cloud data platform receives a package policy including at least one allowlist and at least one blocklist and compares the at least one allowlist and the at least one blocklist to the at least one package specification. The cloud data platform computes a difference set based on the comparison. The difference set includes metadata associated with one or more packages to remove. The cloud data platform determines whether the UDF is permitted based at least in part on the difference set.