-
公开(公告)号:US11036762B1
公开(公告)日:2021-06-15
申请号:US16698417
申请日:2019-11-27
Applicant: Amazon Technologies, Inc.
Inventor: Lewis Bruck , Aishwarya Kamal , Almero Gouws , Derek William Richard Chen-Becker , Haifeng He , Andrey Markin , Akshat Vig
Abstract: A data storage service implements encoding techniques for generating compound partition keys, compound clustering keys, or a combination for more flexibility in storing data in a key-value database system. In some aspects a request to store data with multiple partition keys and/or multiple clustering keys may be received. Length information may be added to the partition keys, and the results concatenated together to form a compound partition key used to store the data in the database. Ordering information may be added to the clustering keys, and the results concatenated together to form a compound clustering key, to be used in storing and sorting data in the database. In some cases, the clustering keys may be made a uniform length, such as by padding keys, as necessary, to have a length that is a multiple of an arbitrary number, and then dividing the clustering keys into chunks of that arbitrary number.
-
公开(公告)号:US11036591B2
公开(公告)日:2021-06-15
申请号:US16035465
申请日:2018-07-13
Applicant: Amazon Technologies, Inc.
Inventor: Maximiliano Maccanti , Timothy Andrew Rath , Rama Krishna Sandeep Pokkunuri , Akshat Vig , Clarence Wing Yin Ng , Srivaths Badrinath Copparam , Rajaprabhu Thiruchi Loganathan , Wei Xiao , William Alexander Stevenson
Abstract: A system that implements a data storage service may store data for database tables in multiple replicated partitions on respective storage nodes. In response to a request to restore a given table that was backed up in a remote storage system (e.g., key-value durable storage system), the service may create a new table, and may import a copy of each of the partitions of the given table from the remote storage system into the new table. The request to restore the table may specify a modified value for a configuration parameter for the table or for one of its partitions. The service may apply the new configuration parameter value to the table or its partitions during the restore operation. The new configuration parameter value may indicate an increase or decrease in storage capacity or throughput capacity, and its application may automatically trigger a partition split or move operation.
-
公开(公告)号:US10853182B1
公开(公告)日:2020-12-01
申请号:US14977474
申请日:2015-12-21
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Lokendra Singh Panwar , Subramanian Sankara Subramanian , Rajaprabhu Thiruchi Loganathan , Parikshit Shivajirao Pol , Rama Krishna Sandeep Pokkunuri , Harini Chandrasekharan
Abstract: In response to determining that a secondary index is to be created for a particular table of a non-relational database service, a service component verifies that automated transmission of change records of the table to a log-structured journal has been configured. A given change record comprises a before-image and an after-image associated with a committed database write, and is assigned a unique sequence number. A change record propagator for the secondary index examines change records stored in the journal, and transmits selected change records to an index storage node. The index storage node builds the secondary index using the selected change records.
-
公开(公告)号:US10666574B2
公开(公告)日:2020-05-26
申请号:US14868236
申请日:2015-09-28
Applicant: Amazon Technologies, Inc.
Inventor: Parikshit Shivajirao Pol , Subramanian Sankara Subramanian , Rajaprabhu Thiruchi Loganathan , Rama Krishna Sandeep Pokkunuri , Gopinath Duddi , Akshat Vig , Safeer Mohiuddin , Sudarshan Narasimhan
IPC: G06F16/30 , H04L12/911 , G06F16/13 , G06F16/901 , G06F16/2455 , G06F9/50 , G06F11/34 , H04L12/26 , G06F11/30
Abstract: Information describing changes to a collection of items maintained by a database may be stored in a log file. The information in the log file may be converted into a stream of records describing the changes. The records may be directed to a computing node selected for performing a trigger function in response to the change, based on applying a hash function to a portion of the record, identifying a hash space associated with a value output by the hash function, and mapping from the hash space to the selected computing node.
-
公开(公告)号:US10482102B2
公开(公告)日:2019-11-19
申请号:US15431706
申请日:2017-02-13
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Timothy Andrew Rath , Stuart Henry Seelye Marshall , Rande A. Blackman , David Alan Lutz , Jian Wang , Jiandan Zheng , Janani Narayanan
IPC: G06F17/30 , G06F16/27 , G06F16/28 , G06F16/90 , G06F16/2458 , G06F16/2455
Abstract: Methods and apparatus for conditional master election in a distributed database are described. A plurality of replicas of a database object are stored by a distributed database service. Some types of operations corresponding to client requests directed at the database object are to be coordinated by a master replica. Client access to the database object is enabled prior to election of a master replica. In response to a triggering condition, a particular replica is elected master. The master coordinates implementation of operations with one or more other replicas in response to client requests.
-
公开(公告)号:US20240160531A1
公开(公告)日:2024-05-16
申请号:US18510518
申请日:2023-11-15
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Tate Andrew Certain , Go Hori
CPC classification number: G06F11/1451 , G06F9/54 , G06F11/1469 , G06F16/2358 , G06F16/278 , G06F2201/84
Abstract: Changes made to a database table are accumulated, in durable storage, and snapshots of partitions of the table are obtained. For successive snapshots of a partition, the system accesses a previous snapshot, applies changes from the accumulated changes, and stores the updated snapshot to a durable data store. The accumulated changes and the successive partition snapshots are made available to restore the database to any point in time across a continuum between successive snapshots. Although each partition of the table may have a backup snapshot that was generated at a time different from when other partition snapshots were generated, changes from respective change logs may be selectively log-applied to distinct partitions of a table to generate an on-demand backup of the entire table at common point-in-time across partitions. Point-in-time restores of a table may rely upon a similar process to coalesce partition snapshots that are not aligned in time.
-
公开(公告)号:US11809404B1
公开(公告)日:2023-11-07
申请号:US17038544
申请日:2020-09-30
Applicant: Amazon Technologies, Inc.
Inventor: Akhilesh Mritunjai , Akshat Vig , Craig Wesley Howard , Hao He
IPC: G06F16/23 , H04L67/1021 , G06F16/27
CPC classification number: G06F16/2365 , G06F16/2358 , G06F16/278 , H04L67/1021
Abstract: Techniques are described for enabling a database service to provide a zonal consistency model for read and write operations involving database tables replicated across a plurality of availability zones of a cloud provider network according to some embodiments. A database service routes zonally consistent operations to request routers and storage nodes that are located in a same availability zone as the client device from which the request originates. For example, in contrast to standard write operations and strongly consistent read operations, which are processed by a leader storage node that may be located in a different availability zone than the originating request, zonally consistent operations can be processed by any storage node and, in particular, by a storage node in a same availability zone as the originating client device.
-
公开(公告)号:US11698914B1
公开(公告)日:2023-07-11
申请号:US17548042
申请日:2021-12-10
Applicant: Amazon Technologies, Inc.
Inventor: Divyank Duvedi , Akshat Vig , Somasundaram Perianayagam , Nicholas Gordon
CPC classification number: G06F16/252 , G06F16/2228 , G06F16/278 , G06F16/28
Abstract: A system receives a request to import data file(s) from a source data store into a target database. The system reserves a first portion of computing resources that host the target database to import the data file(s). The reservation of the first portion of computing resources permits the import throughput rate of the data file(s) through the first portion of computing resources while maintaining a second portion of the computing resources to support client access to the target database at an access throughput rate. The system initiates import of the data file(s) from the source data store to the target database through one or more storage nodes at the import throughput rate according to the first portion of computing resources. The target database is able to receive access requests from one or more clients during the import of the data file(s) to the target database.
-
公开(公告)号:US11687555B2
公开(公告)日:2023-06-27
申请号:US16684901
申请日:2019-11-15
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Timothy Andrew Rath , Stuart Henry Seelye Marshall , Rande A. Blackman , David Alan Lutz , Jian Wang , Jiandan Zheng , Janani Narayanan
IPC: G06F17/30 , G06F16/27 , G06F16/28 , G06F16/90 , G06F16/2458 , G06F16/2455
CPC classification number: G06F16/27 , G06F16/2471 , G06F16/24565 , G06F16/28 , G06F16/90
Abstract: Methods and apparatus for conditional master election in a distributed database are described. A plurality of replicas of a database object are stored by a distributed database service. Some types of operations corresponding to client requests directed at the database object are to be coordinated by a master replica. Client access to the database object is enabled prior to election of a master replica. In response to a triggering condition, a particular replica is elected master. The master coordinates implementation of operations with one or more other replicas in response to client requests.
-
公开(公告)号:US20230185671A1
公开(公告)日:2023-06-15
申请号:US18167802
申请日:2023-02-10
Applicant: Amazon Technologies, Inc.
Inventor: Akshat Vig , Tate A. Certain , Nicholas Gordon , Go Hori
CPC classification number: G06F11/1451 , G06F11/1471 , G06F11/1464 , G06F11/1469 , G06F11/1461 , G06F16/27 , G06F2201/84 , G06F2201/80
Abstract: An interface for requesting, and technique for generation of, a backup of a past state of a database table are provided. Changes made to a database table are accumulated, in durable storage, and snapshots of partitions of the table are obtained. The accumulated changes and the successive partition snapshots are used to generate a past state of the database at any point in time across a continuum between successive snapshots. Although each partition of the table may have a snapshot that was generated at a time different from when other partition snapshots were generated, changes from respective change logs may be selectively log-applied to distinct partitions of a table to generate backup in the past of the entire table at common point-in-time across partitions.
-
-
-
-
-
-
-
-
-