RISK BASED REBUILD OF DATA OBJECTS IN AN ERASURE CODED STORAGE SYSTEM

    公开(公告)号:US20170249213A1

    公开(公告)日:2017-08-31

    申请号:US15055484

    申请日:2016-02-26

    Applicant: NetApp, Inc.

    Abstract: A rebuild node of a storage system can assess risk of the storage system not being able to provide a data object. The rebuild node(s) uses information about data object fragments to determine health of a data object, which relates to the risk assessment. The rebuild node obtains object fragment information from nodes throughout the storage system. With the object fragment information, the rebuild node(s) can assess object risk based, at least in part, on the object fragments indicated as existing by the nodes. To assess object risk, the rebuild node(s) treats absent object fragments (i.e., those for which an indication was not received) as lost. When too many object fragments are lost, an object cannot be rebuilt. The erasure coding technique dictates the threshold number of fragments for rebuilding an object. The risk assessment per object influences rebuild of the objects.

    Risk based rebuild of data objects in an erasure coded storage system

    公开(公告)号:US10514984B2

    公开(公告)日:2019-12-24

    申请号:US15055484

    申请日:2016-02-26

    Applicant: NetApp, Inc.

    Abstract: A rebuild node of a storage system can assess risk of the storage system not being able to provide a data object. The rebuild node(s) uses information about data object fragments to determine health of a data object, which relates to the risk assessment. The rebuild node obtains object fragment information from nodes throughout the storage system. With the object fragment information, the rebuild node(s) can assess object risk based, at least in part, on the object fragments indicated as existing by the nodes. To assess object risk, the rebuild node(s) treats absent object fragments (i.e., those for which an indication was not received) as lost. When too many object fragments are lost, an object cannot be rebuilt. The erasure coding technique dictates the threshold number of fragments for rebuilding an object. The risk assessment per object influences rebuild of the objects.

    DYNAMIC CACHING TECHNIQUE FOR ADAPTIVELY CONTROLLING DATA BLOCK COPIES IN A DISTRIBUTED DATA PROCESSING SYSTEM
    3.
    发明申请
    DYNAMIC CACHING TECHNIQUE FOR ADAPTIVELY CONTROLLING DATA BLOCK COPIES IN A DISTRIBUTED DATA PROCESSING SYSTEM 有权
    用于在分布式数据处理系统中适应性地控制数据块复制的动态缓存技术

    公开(公告)号:US20140156777A1

    公开(公告)日:2014-06-05

    申请号:US13690158

    申请日:2012-11-30

    Applicant: NETAPP, INC.

    Abstract: A dynamic caching technique adaptively controls copies of data blocks stored within caches (“cached copies”) of a caching layer distributed among servers of a distributed data processing system. A cache coordinator of the distributed system implements the dynamic caching technique to increase the cached copies of the data blocks to improve processing performance of the servers. Alternatively, the technique may decrease the cached copies to reduce storage capacity of the servers. The technique may increase the cached copies when it detects local and/or remote cache bottleneck conditions at the servers, a data popularity condition at the servers, or a shared storage bottleneck condition at the storage system. Otherwise, the technique may decrease the cached copies at the servers.

    Abstract translation: 动态缓存技术自适应地控制存储在分布式数据处理系统的服务器之间的缓存层的高速缓存(“高速缓存副本”)中的数据块的副本。 分布式系统的缓存协调器实现动态缓存技术来增加数据块的缓存副本,以提高服务器的处理性能。 或者,该技术可以减少缓存副本以减少服务器的存储容量。 当检测到服务器上的本地和/或远程高速缓存瓶颈状况,服务器上的数据流行状况或存储系统的共享存储瓶颈条件时,该技术可能会增加缓存副本。 否则,该技术可能会降低服务器上的缓存副本。

    Dynamic caching technique for adaptively controlling data block copies in a distributed data processing system
    4.
    发明授权
    Dynamic caching technique for adaptively controlling data block copies in a distributed data processing system 有权
    用于在分布式数据处理系统中自适应控制数据块副本的动态缓存技术

    公开(公告)号:US09385915B2

    公开(公告)日:2016-07-05

    申请号:US13690158

    申请日:2012-11-30

    Applicant: NetApp, Inc.

    Abstract: A dynamic caching technique adaptively controls copies of data blocks stored within caches (“cached copies”) of a caching layer distributed among servers of a distributed data processing system. A cache coordinator of the distributed system implements the dynamic caching technique to increase the cached copies of the data blocks to improve processing performance of the servers. Alternatively, the technique may decrease the cached copies to reduce storage capacity of the servers. The technique may increase the cached copies when it detects local and/or remote cache bottleneck conditions at the servers, a data popularity condition at the servers, or a shared storage bottleneck condition at the storage system. Otherwise, the technique may decrease the cached copies at the servers.

    Abstract translation: 动态缓存技术自适应地控制存储在分布式数据处理系统的服务器之间的缓存层的高速缓存(“高速缓存副本”)中的数据块的副本。 分布式系统的缓存协调器实现动态缓存技术来增加数据块的缓存副本,以提高服务器的处理性能。 或者,该技术可以减少缓存副本以减少服务器的存储容量。 当检测到服务器上的本地和/或远程高速缓存瓶颈状况,服务器上的数据流行状况或存储系统的共享存储瓶颈条件时,该技术可能会增加缓存副本。 否则,该技术可能会降低服务器上的缓存副本。

    ASYNCHRONOUS BACKEND GLOBAL DEDUPLICATION
    5.
    发明申请
    ASYNCHRONOUS BACKEND GLOBAL DEDUPLICATION 审中-公开
    异步后备全球重复

    公开(公告)号:US20150213049A1

    公开(公告)日:2015-07-30

    申请号:US14168348

    申请日:2014-01-30

    Applicant: NetApp, Inc.

    CPC classification number: G06F16/1752

    Abstract: A method of performing a global deduplication may include: collecting a data chunk to be written to a backing storage of a storage system at a staging area in the storage system; generating a data fingerprint of the data chunk; sending the data fingerprint in batch along with other data fingerprints corresponding to data chunks collected at different times to a metadata server system in the storage system; receiving an indication, at the staging area, of whether the data fingerprint is unique in the storage system from the metadata server system; and discarding the data chunk when committing a data object containing the data chunk to the backing storage, when the indication indicates that the data chunk is not unique.

    Abstract translation: 执行全局重复数据删除的方法可以包括:收集要写入存储系统中的暂存区域的存储系统的后备存储器的数据块; 生成数据块的数据指纹; 批量发送数据指纹以及对应于不同时间收集的数据块的其他数据指纹到存储系统中的元数据服务器系统; 在分段区域接收来自元数据服务器系统的数据指纹在存储系统中是否唯一的指示; 并且当指示表示数据块不是唯一时,将包含数据块的数据对象提交给后备存储器时丢弃数据块。

    METHODS FOR IMPLEMENTING NOSQL DATABASE SNAPSHOTS AND DEVICES THEREOF
    6.
    发明申请
    METHODS FOR IMPLEMENTING NOSQL DATABASE SNAPSHOTS AND DEVICES THEREOF 审中-公开
    用于实现NOSQL数据库快照和其设备的方法

    公开(公告)号:US20160275089A1

    公开(公告)日:2016-09-22

    申请号:US14660817

    申请日:2015-03-17

    Applicant: NetApp, Inc.

    Abstract: A method, non-transitory computer readable medium, and system node computing device that generates a snapshot identifier and returns the snapshot identifier in response to a received request to create a snapshot of a No SQL database. When an entry in a transaction table has a first transaction value corresponding to a transaction that has been committed and a second transaction value that is not assigned or corresponds to another transaction that has not been committed, is determined. The snapshot identifier is inserted into the entry when the entry is determined to have the first transaction value corresponding to the transaction that has been committed and the second transaction value that is not assigned or corresponds to the another transaction that has not been committed.

    Abstract translation: 一种方法,非暂时计算机可读介质和系统节点计算设备,其生成快照标识符并响应于接收到的请求而返回快照标识符以创建No SQL数据库的快照。 当事务表中的条目具有对应于已经提交的事务的第一事务值和未分配或对应于尚未提交的另一事务的第二事务值时。 当条目被确定为具有与已经提交的事务相对应的第一事务值和未被分配的第二事务值或者对应于尚未被提交的另一个事务时,该快照标识符被插入该条目中。

    METHODS FOR FACILITATING A NOSQL DATABASE WITH INTEGRATED MANAGEMENT AND DEVICES THEREOF
    7.
    发明申请
    METHODS FOR FACILITATING A NOSQL DATABASE WITH INTEGRATED MANAGEMENT AND DEVICES THEREOF 审中-公开
    一种用于集成管理的NOSQL数据库及其设备的方法

    公开(公告)号:US20160275085A1

    公开(公告)日:2016-09-22

    申请号:US14660816

    申请日:2015-03-17

    Applicant: NetApp, Inc.

    CPC classification number: G06F16/122

    Abstract: A method, non-transitory computer readable medium, and system node computing device that facilitate a NoSQL datastore with integrated management. In some embodiments, this technology provides a fast, highly available, and application integrated NoSQL database that can be established in a data storage network such that various data management policies are automatically implemented. This technology enables application administrators to more effectively leverage NoSQL databases by storing data in tables located on storage nodes in groups and zones that have associated SLCs, as previously established upon creation of the tables or an associated entity group or database. Accordingly, management of the data is relatively integrated and data tiering can be more efficiently implemented. This technology also provides a highly scalable infrastructure that can add capacity having predictable and established service levels dynamically and that optimizes the storage of data on types of media having different characteristics in order to provide cost-effective storage.

    Abstract translation: 一种方法,非暂时性的计算机可读介质和系统节点计算设备,可通过集成管理促进NoSQL数据存储。 在一些实施例中,该技术提供可以在数据存储网络中建立的快速,高可用性和应用集成的NoSQL数据库,从而自动实现各种数据管理策略。 该技术使应用程序管理员能够更有效地利用NoSQL数据库,方法是将数据存储在存储节点上的表和存储关联SLC的区域中,如先前在创建表或关联的实体组或数据库时所创建的。 因此,数据的管理相对集成,并且可以更有效地实现数据分层。 该技术还提供了高度可扩展的基础设施,可以动态地增加具有可预测和建立的服务水平的容量,并且优化在具有不同特征的介质类型上的数据的存储,以便提供具有成本效益的存储。

Patent Agency Ranking