-
公开(公告)号:US09632878B1
公开(公告)日:2017-04-25
申请号:US14032894
申请日:2013-09-20
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
CPC classification number: G06F11/1469 , G06F11/1464 , G06F11/2094 , G06F2201/80
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may export individual partitions of the table from the database and package them to be independently uploaded (e.g., in parallel) to a remote storage system (e.g., a key-value durable storage system). Prior to uploading the exported and packaged partitions to the remote storage system, the service may verify that the exported and packaged partitions can be subsequently restored, which may include unpackaging and/or re-inflating the exported and packaged partitions to create additional unpackaged copies of the partitions, re-importing the additional unpackaged copies of the partitions into the database (e.g., as additional replicas), and/or comparing checksums generated for the exported partitions with checksums generated for the additional unpackaged copies of the partitions.
-
公开(公告)号:US20170093755A1
公开(公告)日:2017-03-30
申请号:US14868236
申请日:2015-09-28
Applicant: Amazon Technologies, Inc.
Inventor: Parikshit Shivajirao Pol , Subramanian Sankara Subramanian , Rajaprabhu Thiruchi Loganathan , Rama Krishna Sandeep Pokkunuri , Gopinath Duddi , Akshat Vig , Safeer Mohiuddin , Sudarshan Narasimhan
IPC: H04L12/911 , H04L12/26 , G06F17/30
Abstract: Information describing changes to a collection of items maintained by a database may be stored in a log file. The information in the log file may be converted into a stream of records describing the changes. The records may be directed to a computing node selected for performing a trigger function in response to the change, based on applying a hash function to a portion of the record, identifying a hash space associated with a value output by the hash function, and mapping from the hash space to the selected computing node.
-
63.
公开(公告)号:US20250139083A1
公开(公告)日:2025-05-01
申请号:US19008360
申请日:2025-01-02
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Sharatkumar Nagesh Kuppahally , Bradley James Curran
IPC: G06F16/23
Abstract: A materialized view management service (MVMS) is capable of monitoring resource allocation changes of a source data object at a source data store and responsively generating resource change alerts to the owner of a target data object (the materialized view) in the target data store. Resource allocation changes may include autoscaling changes to the source data object's partition scheme, throughput limit, storage limit, and the like. The MVMS generates resource change alerts in response to these detected events and pushes the alerts to interested subscribers. Depending on the embodiment, the alerts may be pushed to human administrators, or the target data store itself, which may be configured to automatically adjust the resource allocation of the target data object to match the source data object. Advantageously, the disclosed alerts allow view owners to gain real time visibility of resource auto-scaling at the data source and appropriately react to such changes.
-
公开(公告)号:US12223065B1
公开(公告)日:2025-02-11
申请号:US17547934
申请日:2021-12-10
Applicant: Amazon Technologies, Inc.
Abstract: A resource-based authorization control may be added to a data processing service. A control-plane action requested by an account or entity creates a resource-based authorization policy. The resource-based authorization policy pertaining to respective resources allows recurrent data-plane actions to maintain a data flow in a data pipeline to be authorized independent of a separate authorization service.
-
65.
公开(公告)号:US12222932B1
公开(公告)日:2025-02-11
申请号:US17548373
申请日:2021-12-10
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Sharatkumar Nagesh Kuppahally , Bradley James Curran
IPC: G06F16/23
Abstract: A materialized view management service (MVMS) is capable of monitoring resource allocation changes of a source data object at a source data store and responsively generating resource change alerts to the owner of a target data object (the materialized view) in the target data store. Resource allocation changes may include autoscaling changes to the source data object's partition scheme, throughput limit, storage limit, and the like. The MVMS generates resource change alerts in response to these detected events and pushes the alerts to interested subscribers. Depending on the embodiment, the alerts may be pushed to human administrators, or the target data store itself, which may be configured to automatically adjust the resource allocation of the target data object to match the source data object. Advantageously, the disclosed alerts allow view owners to gain real time visibility of resource auto-scaling at the data source and appropriately react to such changes.
-
公开(公告)号:US11928029B2
公开(公告)日:2024-03-12
申请号:US17019072
申请日:2020-09-11
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
CPC classification number: G06F11/1451 , G06F11/1464 , G06F11/1469 , G06F11/1458 , G06F11/2094 , G06F2201/80
Abstract: A system that implements a data storage service may store data for a database table in multiple replicated partitions on respective storage nodes. In response to a request to back up a table, the service may back up individual partitions of the table to a remote storage system independently and (in some cases) in parallel, and may update (or create) and store metadata about the table and its partitions on storage nodes of the data storage service and/or in the remote storage system. Backing up each partition may include exporting it from the database in which the table is stored, packaging and compressing the exported partition for upload, and uploading the exported, packaged, and compressed partition to the remote storage system. The remote storage system may be a key-value durable storage system in which each backed-up partition is accessible using its partition identifier as the key.
-
公开(公告)号:US11860741B2
公开(公告)日:2024-01-02
申请号:US17687431
申请日:2022-03-04
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Tate Andrew Certain , Go Hori
CPC classification number: G06F11/1451 , G06F9/54 , G06F11/1469 , G06F16/2358 , G06F16/278 , G06F2201/84
Abstract: Changes made to a database table are accumulated, in durable storage, and snapshots of partitions of the table are obtained. For successive snapshots of a partition, the system accesses a previous snapshot, applies changes from the accumulated changes, and stores the updated snapshot to a durable data store. The accumulated changes and the successive partition snapshots are made available to restore the database to any point in time across a continuum between successive snapshots. Although each partition of the table may have a backup snapshot that was generated at a time different from when other partition snapshots were generated, changes from respective change logs may be selectively log-applied to distinct partitions of a table to generate an on-demand backup of the entire table at common point-in-time across partitions. Point-in-time restores of a table may rely upon a similar process to coalesce partition snapshots that are not aligned in time.
-
公开(公告)号:US11604809B1
公开(公告)日:2023-03-14
申请号:US17011758
申请日:2020-09-03
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Rashmi Krishnaiah Setty , Craig Wesley Howard
IPC: G06F16/00 , G06F16/27 , H04L43/0805
Abstract: A distributed database management system comprises database nodes located in a plurality of availability zones. The system receives a request to store a table, and determines to store a number of replicas of the table in one or more availability zones. The system obtains information indicating that one of the availability zones has been designated as preferred. The system identifies a set of database nodes in the preferred availability zone, where the number of database nodes in the subset is sufficient to determine quorum among the replicas. The replicas are stored on the identified set of database nodes.
-
公开(公告)号:US11556540B1
公开(公告)日:2023-01-17
申请号:US16830151
申请日:2020-03-25
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Akhilesh Mritunjai , Somasundaram Perianayagam , James Christopher Sorenson, III
IPC: G06F16/2455 , G06F16/25 , G06F16/23
Abstract: A transmission format cache may be implemented at a database storage node. Versions of data items stored in a database at the database storage node may be processed according to anticipated access requests to generate an anticipated access responses. The anticipated access responses are then stored in a transmission format cache to provide low latency reads of the data items. The versions of the data items may be processed as a result of updates to the database items. The database storage node may be one of a plurality of database storage nodes implementing a distributed database system with the transmission format cache implementing a portion of a distributed response cache providing low latency, eventually consistent or consistent reads of data items in a distributed database.
-
公开(公告)号:US11514079B1
公开(公告)日:2022-11-29
申请号:US16698135
申请日:2019-11-27
Applicant: Amazon Technologies, Inc.
Inventor: Almero Gouws , Derek William Richard Chen-Becker , Haifeng He , Varsha Ganesh , Akshat Vig , Benny Tran
Abstract: A distributed database management system comprises a plurality of peers and maintains data on behalf of a plurality of clients. Upon receiving a request to access data, the distributed database management system identifies, from among the plurality of peers, a set of peers associated with the client issuing the request. The distributed database management system provides, to the client, a list of the set of identified peers. Access to data maintained by the distributed database system is based, at least in part, on connections between the client and the set of identified peers.
-
-
-
-
-
-
-
-
-