-
公开(公告)号:US11586515B1
公开(公告)日:2023-02-21
申请号:US17663941
申请日:2022-05-18
Applicant: Snowflake Inc.
Inventor: Abdullah Al Mahmood , Ruta Dhaneshwar , Xin Huang , Ganeshan Ramachandran Iyer , Jiaxing Liang , Nithin Mahesh , Raghav Ramachandran , Purav B. Saraiya , Yanyi Zhang
Abstract: Described herein are techniques for improving disaster recovery, in particular disaster recovery pertaining to data transfer requests. The data transfer request can be received by each of multiple deployments; however, only a primary deployment can process the request. The data transferred by the primary deployment may be replicated in the secondary deployments. In response to a failover event, one of the secondary deployments can be designated as the new primary development and continue the data transfer based on the data transfer request and the replication information received from the old primary deployment prior to the failover.
-
公开(公告)号:US20240134844A1
公开(公告)日:2024-04-25
申请号:US18321994
申请日:2023-05-22
Applicant: Snowflake Inc.
Inventor: Abdullah Al Mahmood , Ruta Dhaneshwar , Max Heimel , Xin Huang , Canzhou Qu , Purav B. Saraiya , Konstantinos Zoumpatianos
CPC classification number: G06F16/2365 , G06F16/258
Abstract: A data platform including an error handling framework for loading of input data. The data platform generates input data columns based on an input file and generates result data columns based on the input data columns and evaluating expressions. The data platform detects projection errors during the generating of the result data columns and stores result error indicators in error indicator arrays of the result data columns based on the projection errors. The data platform generates filtered result data columns based on the result data columns and the result error indicator arrays of the result data columns and stores the filtered result data columns in a database of the data platform.
-
公开(公告)号:US20250068622A1
公开(公告)日:2025-02-27
申请号:US18948663
申请日:2024-11-15
Applicant: Snowflake Inc.
Inventor: Abdullah Al Mahmood , Tyler Jones , Xin Huang , Ganeshan Ramachandran Iyer , Jiaxing Liang , Daniel Mills , Subramanian Muralidhar , Daniel E. Sotolongo
Abstract: Techniques for creating and using error tables to track errors associated with a base table are described. A command to perform an operation on a base table stored in a network-based data system can be received and executed, causing at least one error. At least one error record corresponding to the at least one error can be inputted into an error table, which is nested with the base table. Contextual information can be added to the at least one error record.
-
公开(公告)号:US20240386010A1
公开(公告)日:2024-11-21
申请号:US18426772
申请日:2024-01-30
Applicant: Snowflake Inc.
Inventor: Abdullah Al Mahmood , Tyler Jones , Xin Huang , Ganeshan Ramachandran Iyer , Jiaxing Liang , Daniel Mills , Subramanian Muralidhar , Daniel E. Sotolongo
Abstract: Techniques for creating and using error tables to track errors associated with a base table are described. A command to perform an operation on a base table stored in a network-based data system can be received and executed, causing at least one error. At least one error record corresponding to the at least one error can be inputted into an error table, which is nested with the base table. Contextual information can be added to the at least one error record.
-
公开(公告)号:US20230376391A1
公开(公告)日:2023-11-23
申请号:US18158586
申请日:2023-01-24
Applicant: Snowflake Inc.
Inventor: Abdullah Al Mahmood , Ruta Dhaneshwar , Xin Huang , Ganeshan Ramachandran Iyer , Jiaxing Liang , Nithin Mahesh , Raghav Ramachandran , Purav B. Saraiya , Yanyi Zhang
CPC classification number: G06F11/2028 , G06F16/27 , G06F11/1435
Abstract: Described herein are techniques for improving disaster recovery, in particular disaster recovery pertaining to data transfer requests. The data transfer request can be received by each of multiple deployments; however, only a primary deployment can process the request. The data transferred by the primary deployment may be replicated in the secondary deployments. In response to a failover event, one of the secondary deployments can be designated as the new primary development and continue the data transfer based on the data transfer request and the replication information received from the old primary deployment prior to the failover.
-
公开(公告)号:US20250061107A1
公开(公告)日:2025-02-20
申请号:US18938063
申请日:2024-11-05
Applicant: Snowflake Inc.
Inventor: Abdullah Al Mahmood , Ruta Dhaneshwar , Max Heimel , Xin Huang , Canzhou Qu , Purav B. Saraiya , Konstantinos Zoumpatianos
IPC: G06F16/23 , G06F16/215 , G06F16/25
Abstract: A data platform including an error handling framework for loading of input data. The data platform generates input data columns based on an input file and generates result data columns based on the input data columns and evaluating expressions. The data platform detects projection errors during the generating of the result data columns and stores result error indicators in error indicator arrays of the result data columns based on the projection errors. The data platform generates filtered result data columns based on the result data columns and the result error indicator arrays of the result data columns and stores the filtered result data columns in a database of the data platform.
-
公开(公告)号:US12169486B2
公开(公告)日:2024-12-17
申请号:US18321994
申请日:2023-05-23
Applicant: Snowflake Inc.
Inventor: Abdullah Al Mahmood , Ruta Dhaneshwar , Max Heimel , Xin Huang , Canzhou Qu , Purav B. Saraiya , Konstantinos Zoumpatianos
IPC: G06F16/23 , G06F16/215 , G06F16/25
Abstract: A data platform including an error handling framework for loading of input data. The data platform generates input data columns based on an input file and generates result data columns based on the input data columns and evaluating expressions. The data platform detects projection errors during the generating of the result data columns and stores result error indicators in error indicator arrays of the result data columns based on the projection errors. The data platform generates filtered result data columns based on the result data columns and the result error indicator arrays of the result data columns and stores the filtered result data columns in a database of the data platform.
-
公开(公告)号:US20240411651A1
公开(公告)日:2024-12-12
申请号:US18810853
申请日:2024-08-21
Applicant: Snowflake Inc.
Inventor: Abdullah Al Mahmood , Ruta Dhaneshwar , Xin Huang , Ganeshan Ramachandran Iyer , Jiaxing Liang , Nithin Mahesh , Raghav Ramachandran , Purav B. Saraiya , Yanyi Zhang
Abstract: Described herein are techniques for improving disaster recovery, in particular disaster recovery pertaining to data transfer requests. The data transfer request can be received by each of multiple deployments; however, only a primary deployment can process the request. The data transferred by the primary deployment may be replicated in the secondary deployments. In response to a failover event, one of the secondary deployments can be designated as the new primary development and continue the data transfer based on the data transfer request and the replication information received from the old primary deployment prior to the failover.
-
公开(公告)号:US11983165B1
公开(公告)日:2024-05-14
申请号:US18128212
申请日:2023-03-29
Applicant: Snowflake Inc.
Inventor: Abdullah Al Mahmood , Chong Han , Ganeshan Ramachandran Iyer , Jiaxing Liang , Nithin Mahesh , Yanrui Zhang
IPC: G06F16/23 , G06F16/174 , G06F16/27
CPC classification number: G06F16/2365 , G06F16/1748 , G06F16/27
Abstract: Embodiments of the present disclosure provide techniques for deduplicating files during internal stage replication using a directory table of the replicated internal stage that is modified as a cache for storing and retrieving original file-level metadata for the replicated files. An initial list of candidate files for loading from the internal stage to a table of the target deployment is prepared based on the files listed in the internal stage, and refined using a directory table lookup. If there is any inconsistency between the files registered in the directory table and the files listed in the internal stage, the target deployment will inspect the user-defined file-level metadata to obtain original file-level metadata for each file that is present in the internal stage but not in the directory table. This information may be used during deduplication to ensure that no duplicate files are loaded.
-
公开(公告)号:US20250103610A1
公开(公告)日:2025-03-27
申请号:US18472849
申请日:2023-09-22
Applicant: Snowflake Inc.
IPC: G06F16/25 , G06F16/215 , G06F16/2453
Abstract: Techniques for ingestion of unstructured files into a target table stored in a network-based database system are described. The unstructured files may include formats not natively supported by a database system. An external service may be used to process the unstructured files. The database system may employ external calls to request the external service to process the unstructured files and provide the results in a specified response schema including metadata.
-
-
-
-
-
-
-
-
-