公开(公告)号：US12277101B2

公开(公告)日：2025-04-15

申请号：US18393279

申请日：2023-12-21

Applicant: Snowflake Inc.

Inventor： Srilakshmi Chintala ,  Jianzhun Du ,  Naresh Kumar ,  Srinath Shankar ,  Leonhard Franz Spiegelberg ,  Eric Shawn Vandenberg ,  Andong Zhan ,  Yun Zou

IPC: G06F16/22 ,  G06F16/11 ,  G06F16/242 ,  G06F16/2453

Abstract: A method provides deterministic row ordering for query result sets in a database system. A framework receives a query referencing a database table and generating a row index column in response. The framework generates the row index column that involves determining an order associated with source files underlying the referenced table and assigns each table row a unique index value based on the file order and row position within the files. The framework executes the received query to produce a result set ordered by the generated row index column. The framework determines row order based on analyzing underlying data file metadata and facilitates returning the result set with consistent, reliable ordering, enabling stable positional-based access semantics when querying distributed database tables.

公开(公告)号：US20240303321A1

公开(公告)日：2024-09-12

申请号：US18661978

申请日：2024-05-13

Applicant: Snowflake Inc.

Inventor： Brandon S. Baker ,  Derek Denny-Brown ,  Mark M. Manning ,  Andong Zhan

IPC: G06F21/53 ,  G06F16/245

CPC classification number: G06F21/53 ,  G06F16/245 ,  G06F2221/033

Abstract: A method for tracing system call execution includes instantiating, by at least one hardware processor of a compute node, a first process and a second process. The second process executes at the compute node as a child process of the first process. detecting a notification associated with a system call initiated by the child process. The child process is pause based on the notification. At least one permission associated with the system call is retrieved via the first process. A determination is made on whether to resume the child process based on the at least one permission.

公开(公告)号：US11494386B2

公开(公告)日：2022-11-08

申请号：US17646905

申请日：2022-01-04

Applicant: Snowflake Inc.

Inventor： Bing Li ,  Edward Ma ,  Mingli Rui ,  Haowei Yu ,  Andong Zhan

IPC: G06F17/30 ,  G06F16/2455 ,  G06F16/25 ,  G06F21/62 ,  G06F16/28 ,  G06F16/27 ,  H04L9/40

Abstract: A shared database platform can interface with a cluster computing platform over a network through a connector. The data transferred over the network can include metadata result packages that can be distributed to worker nodes of the cluster computing platform, which receive the metadata objects and access the result data for further processing on a staging platform, such as a scalable storage platform.

公开(公告)号：US11295009B2

公开(公告)日：2022-04-05

申请号：US17352005

申请日：2021-06-18

Applicant: Snowflake Inc.

Inventor： Elliott Brossard ,  Derek Denny-Brown ,  Isaac Kunen ,  Soumitr Rajiv Pandey ,  Jacob Salassi ,  Srinath Shankar ,  Haowei Yu ,  Andong Zhan

IPC: G06F21/53 ,  G06F21/54 ,  G06F16/22 ,  G06F21/78 ,  H04L29/06 ,  G06F21/62

Abstract: The subject technology receives, in a computing process, a user defined function, the user defined function including code related to at least one operation to be performed. The subject technology determines by a security manager whether performing the at least one operation is permitted, the security manager determines restrictions, based at least in part on a security policy. The subject technology performs the at least one operation. The subject technology sends a result of the at least one operation to the computing process, where sending the result of the at least one operation utilizes a data transport mechanism that supports a network transfer of columnar data.

公开(公告)号：US10719517B1

公开(公告)日：2020-07-21

申请号：US16719218

申请日：2019-12-18

Applicant: Snowflake Inc.

Inventor： Bing Li ,  Edward Ma ,  Mingli Rui ,  Haowei Yu ,  Andong Zhan

IPC: G06F16/2455 ,  G06F16/25 ,  G06F16/28 ,  G06F16/27 ,  G06F21/62 ,  H04L29/06

Abstract: A shared database platform can interface with a cluster computing platform over a network through a connector. The data transferred over the network can include metadata result packages that can be distributed to worker nodes of the duster computing platform, which receive the metadata objects and access the result data for further processing on a staging platform, such as a scalable storage platform.

公开(公告)号：US20250094403A1

公开(公告)日：2025-03-20

申请号：US18393279

申请日：2023-12-21

Applicant: Snowflake Inc.

Inventor： Srilakshmi Chintala ,  Jianzhun Du ,  Naresh Kumar ,  Srinath Shankar ,  Leonhard Franz Spiegelberg ,  Eric Shawn Vandendberg ,  Andong Zhan ,  Yun Zou

IPC: G06F16/22 ,  G06F16/11 ,  G06F16/242 ,  G06F16/2453

Abstract: A method provides deterministic row ordering for query result sets in a database system. A framework receives a query referencing a database table and generating a row index column in response. The framework generates the row index column that involves determining an order associated with source files underlying the referenced table and assigns each table row a unique index value based on the file order and row position within the files. The framework executes the received query to produce a result set ordered by the generated row index column. The framework determines row order based on analyzing underlying data file metadata and facilitates returning the result set with consistent, reliable ordering, enabling stable positional-based access semantics when querying distributed database tables.

公开(公告)号：US20230359727A1

公开(公告)日：2023-11-09

申请号：US18355563

申请日：2023-07-20

Applicant: Snowflake Inc.

Inventor： Brandon S. Baker ,  Dereck Denny-Brown ,  Mark M. Manning ,  Andong Zhan

IPC: G06F21/53 ,  G06F16/245

CPC classification number: G06F21/53 ,  G06F16/245 ,  G06F2221/033

Abstract: A method for tracing function execution includes instantiating, by at least one hardware processor of a computing node, a user-defined function (UDF) server associated with a plurality of configurations. A plurality of child processes of the UDF server are instantiated using the plurality of configurations. A filtering process is configured at an operating system (OS) kernel of the computing node using a child process of the plurality of child processes. The filtering process includes a set of system call categories and a corresponding set of filtering policies. A system call received at the OS kernel and associated with a system call category of the set of system call categories is detected to violate a corresponding filtering policy of the set of filtering policies. A tracing event of the system call is initiated based on the detecting.

公开(公告)号：US20230177145A1

公开(公告)日：2023-06-08

申请号：US18161514

申请日：2023-01-30

Applicant: Snowflake Inc.

Inventor： Brandon S. Baker ,  Derek Denny-Brown ,  Mark M. Manning ,  Andong Zhan

IPC: G06F21/53 ,  G06F16/245

CPC classification number: G06F21/53 ,  G06F16/245 ,  G06F2221/033

Abstract: A method for tracing function execution includes instantiating, by at least one hardware processor of a computing node, a user code runtime configured with access to an operating system (OS) kernel of the computing node. The user code runtime is configured with a first set of filtering policies associated with a first set of allowed system calls. The OS kernel is configured with a second set of filtering policies associated with a second set of allowed system calls. A system call initiated by the user code runtime is detected to violate one or both of the first set of allowed system calls and the second set of allowed system calls. A trace of the system call is initiated based on the detecting.

公开(公告)号：US20220391492A1

公开(公告)日：2022-12-08

申请号：US17809622

申请日：2022-06-29

Applicant: Snowflake Inc.

Inventor： Brandon S. Baker ,  Derek Denny-Brown ,  Mark M. Manning ,  Andong Zhan

IPC: G06F21/53 ,  G06F16/245

Abstract: A system includes at least one hardware processor of a computing node and at least one memory storing instructions that cause the at least one hardware processor to perform operations. The operations include instantiating a user code runtime to execute within a sandbox process. The sandbox process configures access by the user code runtime to an operating system (OS) kernel of the computing node. The OS kernel is configured with one or more filtering policies. A determination is performed of whether a system call received by the OS kernel violates the one or more filtering policies. The system call is triggered by at least one operation of the user code runtime. A tracing event is instantiated to trace execution of the system call based on the determination.

公开(公告)号：US11409864B1

公开(公告)日：2022-08-09

申请号：US17390251

申请日：2021-07-30

Applicant: Snowflake Inc.

Inventor： Brandon S. Baker ,  Derek Denny-Brown ,  Mark M. Manning ,  Andong Zhan

IPC: G06F21/53 ,  G06F16/245

Abstract: Provided herein are systems and methods for tracing and tracing supervision of UDFs in a database system. For example, a method includes receiving a user-defined function (UDF), the UDF including code related to at least one operation to be performed. A user code runtime is instantiated to execute the code of the UDF as a child process. The user code runtime includes a filtering process configured with a plurality of filtering policies. A system call of the at least one operation is detected based on a notification from an operating system (OS) manager, the notification identifying the system call. A determination is made on whether performing the system call is permitted based on the plurality of filtering policies. A report is generated based on the determining.