EFFICIENT DEVICE PROVISION
    52.
    发明申请

    公开(公告)号:US20180287801A1

    公开(公告)日:2018-10-04

    申请号:US15472058

    申请日:2017-03-28

    Abstract: A switching device is implemented in a network-attachable data transfer device to provide data storage access to other such devices. In some embodiments, network-attachable data transfer devices are arranged in a clustered configuration to provide various computational and storage services. When one or more devices of the cluster fails, various implementations associated with the switching device, via an external data interface, provide operational mitigation, optimized data recovery, and efficient reinstatement of normal operation of the cluster.

    Incremental updates of grid encoded data storage systems

    公开(公告)号:US10089176B1

    公开(公告)日:2018-10-02

    申请号:US14789810

    申请日:2015-07-01

    Abstract: Techniques for incrementally updating grid encoding data storage systems are described herein. A grid of shards with a plurality of virtual shards is created where each virtual shard is a representation of a shard in the grid of shards that is not backed by a data storage device and where each shard of the grid of shards has an index value. Data is then stored in the grid of shards by updating a shard to store the data and by also updating a second shard based on a set of shards with the same index value as the shard updated to store the data.

    Consolidating data in storage host groupings

    公开(公告)号:US09858325B1

    公开(公告)日:2018-01-02

    申请号:US14500782

    申请日:2014-09-29

    CPC classification number: G06F11/14 G06F17/30584

    Abstract: A data storage service distributes a plurality of data fragments corresponding to a data object among one or more data storage host groupings in a manner that avoids a possibility of correlated loss of multiple data fragments by consolidation of data of a data storage host grouping onto a single data storage host. The data storage service selects a data storage host grouping and determines an amount of used capacity for the selected data storage host grouping. If the selected grouping satisfies an emptiness threshold, the data storage service selects a data storage host from the grouping and consolidates one or more data sets of the grouping onto the selected data storage host. Subsequently, the data storage service updates metadata for each data storage host of the selected data storage host grouping to specify a location of data stored therein.

    FAILURE-DECOUPLED VOLUME-LEVEL REDUNDANCY CODING TECHNIQUES

    公开(公告)号:US20170300384A1

    公开(公告)日:2017-10-19

    申请号:US15640067

    申请日:2017-06-30

    Abstract: Techniques described and suggested herein include systems and methods for storing, indexing, and retrieving original data of data archives on data storage systems using redundancy coding techniques. For example, redundancy codes, such as erasure codes, may be applied to archives (such as those received from a customer of a computing resource service provider) so as allow the storage of original data of the individual archives available on a minimum of volumes, such as those of a data storage system, while retaining availability, durability, and other guarantees imparted by the application of the redundancy code. Sparse indexing techniques may be implemented so as to reduce the footprint of indexes used to locate the original data, once stored. The volumes may be apportioned into failure-decorrelated subsets, and archives stored thereto may be apportioned to such subsets.

    Generation and verification of erasure encoded fragments

    公开(公告)号:US09753807B1

    公开(公告)日:2017-09-05

    申请号:US14307313

    申请日:2014-06-17

    Abstract: Erasure encoded fragments are generated by an erasure encoding scheme, represented by an erasure encoding matrix, operating on a data file. A new erasure encoded fragment may be generated from previously-generated erasure encoded fragments without reconstructing the original data file. Available and valid erasure encoded fragments are identified and a set of those fragments is selected. A composite encoding matrix is generated based upon the selected fragments and the fragment specified to be generated. The composite matrix is applied to the selected fragments to produce a plurality of partial sums. The partial sums are then combined to generate the specified fragment. The partial sums may be produced by different devices so as to distribute the computational workload and/or to reduce network traffic. The integrity of a generated fragment may be verified by generating the specified fragment twice, using two different sets of fragments, and then comparing the two results.

    Incremental media size extension for grid encoded data storage systems

    公开(公告)号:US09740555B1

    公开(公告)日:2017-08-22

    申请号:US14789778

    申请日:2015-07-01

    Abstract: Techniques for incrementally increasing media size in data storage systems using grid encoded data storage techniques are described herein. A grid of shards is created where each shard of the grid of shards has a first index, a second index and each shard also has an associated storage device configured with a storage capacity that is large enough to store the largest set of data on a shard. Upon determining to replace the storage devices of the grid with storage devices that have a different storage capacity, the storage devices can be incrementally replaced within the grid by first padding each shard of the grid of shards with a set of data values, replacing a data shard storage device with a device of the different storage capacity, and replacing a set of derived shard storage devices with devices of the different storage capacity.

    FAILURE-DECOUPLED VOLUME-LEVEL REDUNDANCY CODING TECHNIQUES
    60.
    发明申请
    FAILURE-DECOUPLED VOLUME-LEVEL REDUNDANCY CODING TECHNIQUES 有权
    失败 - 解码量级冗余编码技术

    公开(公告)号:US20170024281A1

    公开(公告)日:2017-01-26

    申请号:US15283023

    申请日:2016-09-30

    Abstract: Techniques described and suggested herein include systems and methods for storing, indexing, and retrieving original data of data archives on data storage systems using redundancy coding techniques. For example, redundancy codes, such as erasure codes, may be applied to archives (such as those received from a customer of a computing resource service provider) so as allow the storage of original data of the individual archives available on a minimum of volumes, such as those of a data storage system, while retaining availability, durability, and other guarantees imparted by the application of the redundancy code. Sparse indexing techniques may be implemented so as to reduce the footprint of indexes used to locate the original data, once stored. The volumes may be apportioned into failure-decorrelated subsets, and archives stored thereto may be apportioned to such subsets.

    Abstract translation: 本文描述和建议的技术包括使用冗余编码技术在数据存储系统上存储,索引和检索数据归档的原始数据的系统和方法。 例如,诸如擦除代码的冗余代码可以应用于存档(诸如从计算资源服务提供商的客户接收到的那些),以便允许存储最小量的可用的各个归档的原始数据, 例如数据存储系统的那些,同时保持可用性,耐用性以及由应用冗余码赋予的其他保证。 可以实现稀疏索引技术,以便一旦存储就减少用于定位原始数据的索引的占用空间。 这些卷可以被分配成失败相关的子集,并且存储在其中的存档可以被分配给这样的子集。

Patent Agency Ranking