Migration scheduling for fast-mutating metadata records

    公开(公告)号:US10909094B1

    公开(公告)日:2021-02-02

    申请号:US15967433

    申请日:2018-04-30

    Abstract: Systems and methods are provided to implement a metadata record migration system that schedules the migrations of metadata records that are frequently mutated. In embodiments, the scheduler collects timing data of jobs that modify the metadata records, including the timing of various mutation operations within the jobs. In embodiments, when it is determined that a metadata record is to be migrated to a different storage location, the scheduler determines a time to migrate the metadata record. The migration time may lie within a migration window, selected based on an expected migration time needed for the metadata record and the collected time data in order to reduce a probability that record mutations will occur during the migration. In embodiments, the jobs may be snapshot jobs that modify a snapshot record, and the migration may be performed as a result of a cell partitioning operation occurring within the snapshotting system.

    Redundant key management
    13.
    发明授权
    Redundant key management 有权
    冗余密钥管理

    公开(公告)号:US09251097B1

    公开(公告)日:2016-02-02

    申请号:US13919701

    申请日:2013-06-17

    Abstract: A data storage service redundantly stores data and keys used to encrypt the data. Data objects are encrypted with first cryptographic keys. The first cryptographic keys are encrypted by second cryptographic keys. The first cryptographic keys and second cryptographic keys are redundantly stored in a data storage system to enable access of the data objects, such as to respond to requests to retrieve the data objects. The second cryptographic keys may be encrypted by third keys and redundantly stored in the event access to a second cryptographic key is lost.

    Abstract translation: 数据存储服务冗余地存储用于加密数据的数据和密钥。 数据对象使用第一加密密钥进行加密。 第一加密密钥由第二加密密钥加密。 第一加密密钥和第二加密密钥被冗余地存储在数据存储系统中,以使数据对象能够访问,例如响应检索数据对象的请求。 可以通过第三密钥来加密第二加密密钥,并且在丢失对第二加密密钥的访问的情况下被冗余地存储。

    Write horizon data management
    14.
    发明授权
    Write horizon data management 有权
    写地平线数据管理

    公开(公告)号:US09037825B1

    公开(公告)日:2015-05-19

    申请号:US13682501

    申请日:2012-11-20

    Abstract: Conditions are enforced to prevent unintended deletion of data stored by a data storage system. For example, to delete a collection of data, a condition on the collection of data's size may be enforced. The collection may be required to be empty, for example. In addition, a condition that there not exist a pending data processing operation that can affect fulfillment of the condition on the collection of data's size is also enforced.

    Abstract translation: 执行条件以防止意外删除数据存储系统存储的数据。 例如,要删除数据集合,可能会强制收集数据大小的条件。 例如,集合可能需要为空。 此外,还强制执行不存在可能影响对数据大小收集的条件的等待数据处理操作的条件。

    Hierarchical token buckets
    16.
    发明授权

    公开(公告)号:US11616725B1

    公开(公告)日:2023-03-28

    申请号:US17305130

    申请日:2021-06-30

    Abstract: Systems and methods are provided for efficient handling of user requests to access shared resources in a distributed system, which handling may include throttling access to resources on a per-resource basis. A distributed load-balancing system can be logically represented as a hierarchical token bucket cache, where a global cache contains token buckets corresponding to individual resources whose tokens can be dispensed to service hosts each maintaining a local cache with token buckets that limit the servicing of requests to access those resources. Local and global caches can be implemented with a variant of a lazy token bucket algorithm to enable limiting the amount of communication required to manage cache state. High granularity of resource management can thus enable increased throttle limits on user accounts without risking overutilization of individual resources.

    Incremental restore for volumes using object-based snapshots

    公开(公告)号:US11586375B1

    公开(公告)日:2023-02-21

    申请号:US17304931

    申请日:2021-06-28

    Abstract: Systems and methods are provided for conducting incremental restore operations on block storage volumes using an object-based snapshot. A full restore from an object-based snapshot can include copying all blocks of a data set from the object-based snapshot to a destination volume. For high capacity volumes, full restores may take large amounts of time. Moreover, full restores may be inefficient where a destination volume already contains some data of the snapshot. Embodiments of the present disclosure provide for incremental restore operations, where a delta data set is transferred from the snapshot to the destination volume, representing data in the snapshot is not known to already exist on the volume or another available volume.

    NETWORK-ACCESSIBLE BLOCK-LEVEL SNAPSHOTS

    公开(公告)号:US20210096961A1

    公开(公告)日:2021-04-01

    申请号:US16586683

    申请日:2019-09-27

    Abstract: Generally described, one or more aspects of the present application relate to a public snapshot service for creating and managing block-level snapshots. For example, the public snapshot service can create a snapshot based on (i) a specification of a parent snapshot to be used as a basis for a given snapshot, and (ii) a specification of the data blocks to be backed up in the given snapshot. The data blocks in the snapshot may be stored in a specific storage path structure that facilitates computation of a block difference with respect to the parent snapshot.

    REDUNDANT KEY MANAGEMENT
    20.
    发明申请
    REDUNDANT KEY MANAGEMENT 有权
    冗余关键管理

    公开(公告)号:US20160154963A1

    公开(公告)日:2016-06-02

    申请号:US15004592

    申请日:2016-01-22

    Abstract: A data storage service redundantly stores data and keys used to encrypt the data. Data objects are encrypted with first cryptographic keys. The first cryptographic keys are encrypted by second cryptographic keys. The first cryptographic keys and second cryptographic keys are redundantly stored in a data storage system to enable access of the data objects, such as to respond to requests to retrieve the data objects. The second cryptographic keys may be encrypted by third keys and redundantly stored in the event access to a second cryptographic key is lost.

    Abstract translation: 数据存储服务冗余地存储用于加密数据的数据和密钥。 数据对象使用第一加密密钥进行加密。 第一加密密钥由第二加密密钥加密。 第一加密密钥和第二加密密钥被冗余地存储在数据存储系统中,以使数据对象能够访问,例如响应检索数据对象的请求。 可以通过第三密钥来加密第二加密密钥,并且在丢失对第二加密密钥的访问的情况下被冗余地存储。

Patent Agency Ranking