公开(公告)号：WO2018200036A1

公开(公告)日：2018-11-01

申请号：PCT/US2017/067627

申请日：2017-12-20

Applicant: NETAPP INC.

Inventor： GEORGE, Tijin ,  MATHEW, Jose ,  PERANNAGARI, Harsha, Vardhan Reddy

IPC: G06F12/0888 ,  G06F3/06 ,  G06F12/0868 ,  G06F12/0866 ,  G06F11/20

Abstract: Methods, non-transitory computer readable media, and computing devices that receive data from a primary storage node. The data is stored in a primary volume within a primary composite aggregate hosted by the primary storage node. A determination is made when the data is tagged to indicate that the data is stored in the primary volume on a remote data storage device of the primary composite aggregate. The data is stored on another remote data storage device without storing the data in a local data storage device, when the determining indicates that the data is tagged to indicate that the data is stored in the primary volume on a remote data storage device of the primary composite aggregate. Accordingly, this technology allows data placement to remain consistent across primary and secondary volumes and facilitates efficient operation of secondary storage nodes by eliminating two-phase writes for data stored on cloud storage devices.

公开(公告)号：WO2018081729A1

公开(公告)日：2018-05-03

申请号：PCT/US2017/059079

申请日：2017-10-30

Applicant: NETAPP, INC.

Inventor： KUSHWAH, Ajay Pratap, Singh ,  ZHENG, Ling ,  JAIN, Sharad

IPC: G06F11/14 ,  G06F17/30

Abstract: With a forever incremental snapshot configuration and a typical caching policy (e.g., least recently used), a storage appliance may evict stable data blocks of an older snapshot, perhaps unchanged data blocks of the snapshot baseline. If stable data blocks have been evicted, restore of a recent snapshot will suffer the time penalty of downloading the stable blocks for restoring the recent snapshot. Creating synthetic baseline snapshots and refreshing eviction data of stable data blocks can avoid eviction of stable data blocks and reduce the risk of violating a recovery time objective.

Abstract translation: 利用永久增量快照配置和典型的高速缓存策略（例如，最近最少使用），存储设备可以驱逐较旧快照的稳定数据块，可能是快照基线的未改变的数据块。 如果稳定的数据块已被逐出，则恢复最近的快照将承受下载用于恢复最近快照的稳定块的时间损失。 创建合成基线快照并刷新稳定数据块的逐出数据可以避免逐出稳定数据块并降低违反恢复时间目标的风险。

公开(公告)号：WO2017132312A1

公开(公告)日：2017-08-03

申请号：PCT/US2017/015025

申请日：2017-01-26

Applicant: NETAPP, INC.

Inventor： KAUSHIK, Akhil ,  PONNAPUR, Anik, Kumar ,  RAGHAVAN, Aravind, Srinivasa ,  SUNDARARAJAN, Manoj, Kumar V.

IPC: G06F3/06

CPC classification number: G06F3/065 ,  G06F3/061 ,  G06F3/0617 ,  G06F3/0619 ,  G06F3/0658 ,  G06F3/0659 ,  G06F3/067 ,  G06F3/0683

Abstract: One or more techniques and/or computing devices are provided for resilient replication of storage operations. For example, a first storage controller may host first storage having a replication relationship with second storage hosted by a second storage controller. To improve resiliency against transient network issues of a network between the storage controllers, the first storage controller may implement a queue and retry mechanism to retry replication operations not acknowledge back by the second storage controller within a threshold time. The second storage controller may maintain a cumulative sequence number of a latest replication operation performed in order, an operation response map of replication operations performed out of order, and an operation finder map identifying currently implemented replication operations, which may be used to process incoming replication operations. Single write semantics, write order consistency, and reduction of write amplification may be provided.

Abstract translation: 提供一个或多个技术和/或计算设备用于存储操作的弹性复制。 例如，第一存储控制器可以托管与第二存储控制器托管的第二存储具有复制关系的第一存储。 为了提高针对存储控制器之间的网络的暂时网络问题的弹性，第一存储控制器可以实现队列和重试机制，以在阈值时间内重试第二存储控制器不应答的复制操作。 第二存储控制器可以保持按顺序执行的最新复制操作的累积序列号，乱序执行的复制操作的操作响应映射以及标识当前实现的复制操作的操作查找映射，其可以用于处理到来的复制 操作。 可以提供单写入语义，写入顺序一致性和减少写入放大。

公开(公告)号：WO2017116844A1

公开(公告)日：2017-07-06

申请号：PCT/US2016/067741

申请日：2016-12-20

Applicant: NETAPP, INC.

Inventor： EISLER, Michael, Robin ,  RAO, Santosh, Ananth ,  KAUSHIK, Akhil ,  MU, Yuedong

IPC: G06F11/20

CPC classification number: G06F3/065 ,  G06F3/0619 ,  G06F3/067 ,  G06F11/2058 ,  G06F11/2064 ,  G06F11/2069 ,  G06F11/2076 ,  G06F11/2082

Abstract: One or more techniques and/or computing devices are provided for synchronous replication. For example, synchronous replication relationships are established between a first storage object (e.g., a file, a logical unit number (LUN), a consistency group, etc.), hosted by a first storage controller, and a plurality of replication storage objects hosted by other storage controllers. In this way, a write operation to the first storage object is implemented in parallel upon the first storage object and the replication storage objects in a synchronous manner, such as using a zero-copy operation to reduce overhead otherwise introduced by performing copy operations. Reconciliation is performed in response to a failure so that the first storage object and the replication storage objects comprise consistent data. Failed write operations and replication write operations are retried, while enforcing a single write semantic. Dependent write order consistency is enforced for dependent write operations, such as overlapping write operations.

Abstract translation: 为同步复制提供一个或多个技术和/或计算设备。 例如，在由第一存储控制器托管的第一存储对象（例如，文件，逻辑单元号（LUN），一致性组等）与托管的多个复制存储对象之间建立同步复制关系 由其他存储控制器。 以这种方式，对第一存储对象的写入操作以同步的方式并行地实现在第一存储对象和复制存储对象上，诸如使用零复制操作来减少否则通过执行复制操作引入的开销。 调整是为了响应故障而执行的，以便第一个存储对象和复制存储对象包含一致的数据。 重试失败的写入操作和复制写入操作，同时强制执行单个写入语义。 依赖写入顺序一致性是针对从属写入操作实施的，例如重叠写入操作。

公开(公告)号：WO2017091566A1

公开(公告)日：2017-06-01

申请号：PCT/US2016/063305

申请日：2016-11-22

Applicant: NETAPP, INC.

Inventor： POWELL, Paul, Anthony ,  KAUSHIK, Akhil ,  NATARAJAN, Srikumar ,  NGAN, Ching-Yuk, Paul

IPC: G06F3/06 ,  G06F11/20

CPC classification number: H04L67/1095 ,  G06F3/0614 ,  G06F3/065 ,  G06F3/067 ,  G06F11/2064 ,  G06F11/2069 ,  G06F17/30174 ,  G06F17/30215 ,  G06F2201/805 ,  H04L67/1097

Abstract: One or more techniques and/or computing devices are provided for implementing synchronous replication. For example, a synchronous replication relationship may be established between a first storage controller hosting local storage and a second storage controller hosting remote storage (e.g., replication may be specified at a file, logical unit number (LUN), or any other level of granularity). Data operations and offloaded operations may be implemented in parallel upon the local storage and the remote storage. Error handling operations may be implemented upon the local storage and implement in parallel as a best effort on the remote storage, and a reconciliation may be performed to identify any data divergence from the best effort parallel implementation. Storage area network (SAN) operations may be implemented upon the local storage, and upon local completion may be remotely implemented upon the remote storage.

Abstract translation: 为实现同步复制提供了一个或多个技术和/或计算设备。 例如，可以在托管本地存储的第一存储控制器和托管远程存储的第二存储控制器之间建立同步复制关系（例如，可以在文件，逻辑单元号（LUN）或任何其他级别的粒度上指定复制 ）。 数据操作和卸载操作可以在本地存储器和远程存储器上并行实施。 错误处理操作可以在本地存储器上实现，并作为尽力而为的方式并行实现在远程存储器上，并且可以执行协调以识别来自尽力而为的并行实现的任何数据分歧。 存储区域网络（SAN）操作可以在本地存储器上实现，并且在本地完成时可以在远程存储器上远程实现。

公开(公告)号：WO2017079175A2

公开(公告)日：2017-05-11

申请号：PCT/US2016/059943

申请日：2016-11-01

Applicant: NETAPP, INC.

Inventor： RANDALL, Charles ,  WRIGHT, David D. ,  XU, Michael

IPC: G06F3/06

CPC classification number: G06F3/0608 ,  G06F3/061 ,  G06F3/064 ,  G06F3/0673

Abstract: Disclosed are systems, computer-readable mediums, and methods for transforming data in a file system. As part of a recycling process, a determination is made that transformations should be attempted. A data block is determined to be in use by at least one user of the storage system. If a transformation should be attempted on the data block is determined. Parameters associated with the performance of the file system can be used in this determination. A type of transformation to be done is determined. The data block is transformed based upon the selected transformation. The transformed data block is written to the storage system. As part of the recycling process, the transformation requires no additional input/output requests.

Abstract translation: 公开了用于变换文件系统中的数据的系统，计算机可读介质和方法。 作为回收过程的一部分，确定应该尝试转换。 数据块被确定为由存储系统的至少一个用户使用。 如果应该尝试在数据块上进行转换，则确定。 在这个确定中可以使用与文件系统的性能相关的参数。 确定要完成的一种类型的转换。 数据块根据选择的变换进行变换。 转换后的数据块被写入存储系统。 作为回收处理的一部分，转换不需要额外的输入/输出请求。

公开(公告)号：WO2017062494A1

公开(公告)日：2017-04-13

申请号：PCT/US2016/055553

申请日：2016-10-05

Applicant: NETAPP, INC.

Inventor： JESS, Martin ,  MOORE, Joseph ,  HUANG, Ziling

IPC: G06F11/08 ,  G06F11/16 ,  G06F11/20 ,  G06F15/16 ,  G06F15/177

CPC classification number: G06F11/2069 ,  G06F11/1092 ,  G06F2201/805 ,  G06F2201/85

Abstract: A system, method, and machine-readable storage medium for recovering data in a distributed storage system are provided. In some embodiments, the method includes identifying a failing storage device of a first storage node having an inaccessible data segment. When it is determined that the inaccessible data segment cannot be recovered using a first data protection scheme, a first chunk of data associated with the inaccessible data segment is identified and a group associated with the first chunk of data is identified. A second chunk of data associated with the group is selectively retrieved from a second storage node such that data associated with an accessible data segment of the first storage node is not retrieved. The inaccessible data segment is recovered by recovering the first chunk of data using a second data protection scheme and the second chunk of data.

Abstract translation: 提供了一种用于在分布式存储系统中恢复数据的系统，方法和机器可读存储介质。 在一些实施例中，该方法包括识别具有不可访问数据段的第一存储节点的故障存储设备。 当确定使用第一数据保护方案不能恢复不可访问的数据段时，识别与不可访问的数据段相关联的第一数据块，并且识别与第一块数据相关联的组。 从第二存储节点选择性地检索与组相关联的第二数据块，使得与第一存储节点的可访问数据段相关联的数据不被检索。 通过使用第二数据保护方案和第二数据块来恢复第一数据块来恢复不可访问的数据段。

公开(公告)号：WO2016168674A1

公开(公告)日：2016-10-20

申请号：PCT/US2016/027864

申请日：2016-04-15

Applicant: NETAPP, INC.

Inventor： BALACHANDRAN, Ajith ,  JAMES, Namboorikandathil, Joseph ,  EISLER, Michael, R. ,  PRADEEP, Rahul ,  KUMAR, Somesh ,  SRINATH, Vijay ,  MU, Yuedong

IPC: G06F11/14

CPC classification number: G06F3/0619 ,  G06F3/0644 ,  G06F3/065 ,  G06F3/0683 ,  G06F11/00 ,  G06F11/1446 ,  G06F11/1451 ,  G06F11/1458

Abstract: First partial baseline data of a first storage system is identified. First changed data of the first storage system is identified. The first changed data comprises data that has changed since a previous point in time. First backup data is written to a second storage system. The first backup data comprises the first partial baseline data and the first changed data. After writing the first backup data to the second storage system, second partial baseline data of the first storage system is identified. The second partial baseline data does not include the first partial baseline data. Second changed data of the first storage system is identified. The second changed data comprises data that has changed since writing the first backup data. Second backup data is written to the second storage system. The second backup data comprises the second partial baseline data and the second changed data.

Abstract translation: 识别第一存储系统的第一部分基线数据。 识别第一个存储系统的第一个更改的数据。 第一个更改的数据包括自上一个时间点以来发生变化的数据。 第一个备份数据被写入第二个存储系统。 第一备份数据包括第一部分基线数据和第一改变数据。 在将第一备份数据写入第二存储系统之后，识别第一存储系统的第二部分基准数据。 第二部分基线数据不包括第一部分基线数据。 识别第一个存储系统的第二个更改的数据。 第二改变的数据包括自编写第一备份数据以来已经改变的数据。 第二个备份数据被写入第二个存储系统。 第二备份数据包括第二部分基线数据和第二改变的数据。

公开(公告)号：WO2016057537A1

公开(公告)日：2016-04-14

申请号：PCT/US2015/054275

申请日：2015-10-06

Applicant: NETAPP, INC.

Inventor： BANERJEE, Arindam ,  HUMLICEK, Donald R.

IPC: G06F12/00

CPC classification number: G06F12/084 ,  G06F3/061 ,  G06F3/0644 ,  G06F3/0673 ,  G06F12/0864 ,  G06F12/0873 ,  G06F2212/1021 ,  G06F2212/1044 ,  G06F2212/312 ,  G06F2212/604 ,  G06F2212/608

Abstract: Methods and systems for managing caching mechanisms in storage systems are provided where a global cache management function manages multiple independent cache pools and a global cache pool. As an example, the method includes: splitting a cache storage into a plurality of independently operating cache pools, each cache pool comprising storage space for storing a plurality of cache blocks for storing data related to an input/output ("I/O") request and metadata associated with each cache pool; receiving the I/O request for writing a data; operating a hash function on the I/O request to assign the I/O request to one of the plurality of cache pools; and writing the data of the I/O request to one or more of the cache blocks associated with the assigned cache pool. In an aspect, this allows efficient I/O processing across multiple processors simultaneously.

Abstract translation: 提供了用于管理存储系统中的缓存机制的方法和系统，其中全局高速缓存管理功能管理多个独立的缓存池和全局缓存池。 作为示例，该方法包括：将高速缓存存储器分割成多个独立操作的高速缓存池，每个高速缓存池包括用于存储用于存储与输入/输出（“I / O”）有关的数据的多个高速缓存块的存储空间， 与每个缓存池相关联的请求和元数据; 接收写入数据的I / O请求; 在所述I / O请求上操作散列函数以将所述I / O请求分配给所述多个缓存池中的一个; 以及将I / O请求的数据写入与所分配的高速缓存池相关联的一个或多个缓存块。 在一个方面，这允许同时跨多个处理器进行高效的I / O处理。

公开(公告)号：WO2016048899A1

公开(公告)日：2016-03-31

申请号：PCT/US2015/051228

申请日：2015-09-21

Applicant: NETAPP, INC.

Inventor： VIJAYAN, Anoop, Chakkalakkal

IPC: G06F11/20 ,  H04L29/08

CPC classification number: G06F17/30174 ,  G06F3/0607 ,  G06F3/0665 ,  G06F3/0667 ,  G06F11/0712 ,  G06F11/1484 ,  G06F11/1658 ,  G06F11/20 ,  G06F11/2089 ,  G06F17/302 ,  H04L67/1095 ,  H04L67/1097

Abstract: A configuration for a component of a primary node is synchronized with a configuration for a component of a partner node in a different cluster by replicating the primary node configuration with the partner node. A baseline configuration replication comprises a snapshot of a component configuration on the primary. The baseline configuration can be generated by traversing through the configuration objects, capturing their attributes and encapsulating them in a package. The baseline package can then be transferred to the partner node. The configuration objects can be applied on the partner node in the order in which they were captured on the primary node. Attributes of the configuration objects are identified that are to be transformed. Values for the identified attributes are transformed from a name space in the primary node to a name space in the partner node.

Abstract translation: 通过将主节点配置与伙伴节点进行复制，用于主节点的组件的配置与不同集群中的伙伴节点的组件的配置同步。 基准配置复制包括主要组件配置的快照。 可以通过遍历配置对象，捕获其属性并将其封装在包中来生成基线配置。 然后可以将基准包转移到伙伴节点。 配置对象可以按照它们在主节点上捕获的顺序应用于伙伴节点上。 识别要转换的配置对象的属性。 标识属性的值从主节点的名称空间转换为伙伴节点中的名称空间。