公开(公告)号：WO2003009286A2

公开(公告)日：2003-01-30

申请号：PCT/US2001/051321

申请日：2001-10-25

Applicant: NETWORK APPLIANCE, INC.

Inventor： KAHN, Andy ,  SUNDARAM, Rajesh ,  VISWANATHAN, Srinivasan ,  KLEIMAN, Steven, R.

IPC: G11B20/00

CPC classification number: G06F11/1076 ,  G11B20/18 ,  H03M13/096

Abstract: A method and apparatus for a reliable data storage system using block level checksums appended to data blocks. Files are stored on hard disks in storage blocks, including data blocks and block-appended checksums. The block-appended checksum includes a checksum of the data block, a VBN, a DBN, and an embedded checksum for checking the integrity of the block-appended checksum itself. A file system includes file blocks with associated block-appended checksum to the data blocks. The file blocks with block-appended checksums are written to storage blocks. In a preferred embodiment a collection of disk drives are formatted with 520 bytes of data per sector. For each 4,096-byte file block, a corresponding 64-byte block-appended checksum is appended to the file block with the first 7 sectors including most of the file block data while the 8th sector includes the remaining file block data and the 64-byte block-appended checksum.

Abstract translation: 用于使用附加到数据块的块级校验和的可靠数据存储系统的方法和设备。 文件存储在硬盘上的存储块中，包括数据块和块附加校验和。 附加块的校验和包括数据块的校验和，VBN，DBN和嵌入校验和，用于检查块附加校验和本身的完整性。 一个文件系统包括文件块，并在数据块中附加了与块相关的校验和。 带块添加校验和的文件块被写入存储块。 在一个优选实施例中，磁盘驱动器的集合被格式化为每个扇区520个字节的数据。 对于每个4,096字节的文件块，相应的64字节的块附加校验和被附加到文件块，前7个扇区包括大部分文件块数据，而第8个扇区包括剩余的文件块数据和64字节 块添加校验和。

公开(公告)号：WO2004001600A1

公开(公告)日：2003-12-31

申请号：PCT/US2003/020119

申请日：2003-06-24

Applicant: NETWORK APPLIANCE, INC.

Inventor： KLEIMAN, Steven, R. ,  STRANGE, Stephen, H.

IPC: G06F11/00

CPC classification number: G06F11/1662 ,  G06F11/1092 ,  G06F11/2082 ,  G06F11/2094

Abstract: On disk failure (210), the storage system migrates only those disk blocks that included allocated data, and treats unallocated disk blocks as being logically zero when possible. When there is no spare disk, the source disk block is logically set to zero and parity is recalculated for the RAID stripe associated with the source disk block (223). When there is a spare, unallocated blocks on the spare are logically or physically set to zero upon migration (222). Write operations for the failed disk are redirected to other non-failing disks, and a record of which in-use disk blocks have been thus "migrated" to those other non-failing disks in maintained. Unused disk blocks are proactively set to zero. A target mirror copy is created using information regarding allocated disk blocks, by copying those blocks including allocated data or parity, and by clearing at the mirror those blocks not including any allocated.

Abstract translation: 在磁盘故障（210）中，存储系统仅迁移那些包含已分配数据的磁盘块，并尽可能将未分配的磁盘块视为逻辑0。 当没有备用磁盘时，源磁盘块在逻辑上设置为零，并为与源磁盘块相关联的RAID条带重新计算奇偶校验（223）。 当有空闲时，备用磁盘上的未分配块在迁移时逻辑或物理设置为零（222）。 故障磁盘的写入操作将重定向到其他未发生故障的磁盘，并且将已使用磁盘块的记录“已迁移”到维护中的其他未发生故障的磁盘。 未使用的磁盘块主动设置为零。 使用关于分配的磁盘块的信息来创建目标镜像副本，通过复制包括分配的数据或奇偶校验的那些块，并且通过在镜子上清除不包括任何分配的那些块。

公开(公告)号：WO2005043378A2

公开(公告)日：2005-05-12

申请号：PCT/US2004/036343

申请日：2004-11-01

Applicant: NETWORK APPLIANCE, INC. ,  KLEIMAN, Steven, R. ,  ENGLISH, Robert, M. ,  CORBETT, Peter, F.

Inventor： KLEIMAN, Steven, R. ,  ENGLISH, Robert, M. ,  CORBETT, Peter, F.

IPC: G06F3/06

CPC classification number: G06F11/1076 ,  G06F11/1088

Abstract: A dynamic parity distribution system and technique distributes parity across disks of an array. The dynamic parity distribution system includes a storage operating system that integrates a file system with a RAID system. In response to a request to store (write) data on the array, the file system determines which disks contain free blocks in a next allocated stripe of the array. There may be multiple blocks within the stripe that do not contain file system data (i.e., unallocated data blocks) and that could potentially store parity. One or more of those unallocated data blocks can be assigned to store parity, arbitrarily. According to the dynamic parity distribution technique, the file system determines which blocks hold parity each time there is a write request to the stripe. The technique alternately allows the RAID system to assign a block to contain parity when each stripe is written.

Abstract translation: 动态奇偶校验分配系统和技术在阵列的磁盘上分配奇偶校验。 动态奇偶校验分配系统包括将文件系统与RAID系统集成的存储操作系统。 响应于在阵列上存储（写入）数据的请求，文件系统确定哪个磁盘在数组的下一个分配的条带中包含空闲块。 条带内可能存在不包含文件系统数据（即，未分配的数据块）并且可能存储奇偶校验的多个块。 这些未分配数据块中的一个或多个可以被任意地分配给存储奇偶校验。 根据动态奇偶校验分配技术，文件系统确定哪个块在每次存在针对条带的写入请求时保持奇偶校验。 该技术交替地允许RAID系统在写入每个条带时分配块以包含奇偶校验。

公开(公告)号：WO2006118957A3

公开(公告)日：2006-11-09

申请号：PCT/US2006/016055

申请日：2006-04-27

Applicant: NETWORK APPLIANCE, INC.

Inventor： CORBETT, Peter, F. ,  ENGLISH, Robert, M. ,  KLEIMAN, Steven, R.

IPC: G06F3/06

Abstract: A technique places content, such as data, of one or more data containers on volumes of a striped volume set (SVS). The placement of data across the volumes of the SVS allows specification of a deterministic pattern of fixed length. That is, the pattern determines a placement of data of a data container that is striped among the volumes of the SVS. The placement pattern is such that the stripes are distributed exactly or nearly equally among the volumes and that, within any local span of a small multiple of the number of volumes, the stripes are distributed nearly equally among the volumes. The placement pattern is also substantially similar for a plurality of SVSs having different numbers of volumes.

公开(公告)号：WO2005052784A2

公开(公告)日：2005-06-09

申请号：PCT/US2004/039618

申请日：2004-11-24

Applicant: NETWORK APPLIANCE, INC. ,  CORBETT, Peter, F. ,  ENGLISH, Robert, M. ,  KLEIMAN, Steven, R.

Inventor： CORBETT, Peter, F. ,  ENGLISH, Robert, M. ,  KLEIMAN, Steven, R.

IPC: G06F3/06

CPC classification number: G06F11/1096

Abstract: A semi-static distribution technique distributes parity across disks of an array. According to the technique, parity is distributed (assigned) across the disks of the array in a manner that maintains a fixed pattern of parity blocks among the stripes of the disks. When one or more disks are added to the array, the semi-static technique redistributes parity in a way that does not require recalculation of parity or moving of any data blocks. Notably, the parity information is not actually moved; the technique merely involves a change in the assignment (or reservation) for some of the parity blocks of each pre-existing disk to the newly added disk.

Abstract translation: 半静态分配技术在阵列的磁盘上分配奇偶校验。 根据该技术，奇偶校验以在盘的条带之间维持奇偶校验块的固定模式的方式分布（分配）在阵列的盘上。 当将一个或多个磁盘添加到阵列中时，半静态技术以不需要重新计算奇偶校验或移动任何数据块的方式重新分配奇偶校验。 值得注意的是，奇偶校验信息实际上没有被移动; 该技术仅涉及将每个预先存在的磁盘的一些奇偶校验块的分配（或预留）改变为新添加的磁盘。

公开(公告)号：WO2009058189A1

公开(公告)日：2009-05-07

申请号：PCT/US2008/011502

申请日：2008-10-06

Applicant: NETWORK APPLIANCE, INC.

Inventor： ENGLISH, Robert, M. ,  KLEIMAN, Steven, R.

IPC: G06F3/06

CPC classification number: G06F3/0656 ,  G06F3/0613 ,  G06F3/0643 ,  G06F3/0644 ,  G06F3/0689 ,  G06F12/0804

Abstract: An improved system and method enhances performance of updates to sequential block storage of a storage system. A disk-based sort procedure is provided to establish locality among updates (write data) held in a disk-based log, thereby enabling the write data to be efficiently written to home locations on a home location array. As the write data is received, a log manager of the storage system temporarily stores the data efficiently on the disk-based log. As more write data arrives, the log manager sorts the data in the log in accordance with the sort procedure, thus increasing the locality of data when stored on the home location array. When the log approaches capacity, the log manager writes the sorted data to their home locations on the array with high locality and performance.

Abstract translation: 改进的系统和方法增强了对存储系统的顺序块存储的更新的性能。 提供基于磁盘的分类程序以在保持在基于磁盘的日志中的更新（写入数据）之间建立位置，从而使写入数据能够有效地写入归属位置阵列上的归属位置。 当接收到写入数据时，存储系统的日志管理器将有效的数据临时存储在基于磁盘的日志上。 随着更多的写入数据到达，日志管理器根据分类过程对日志中的数据进行排序，从而在存储在归属位置数组上时增加数据的位置。 当日志接近容量时，日志管理器将排序数据写入阵列的本地位置和性能很高。

公开(公告)号：WO2005052855A2

公开(公告)日：2005-06-09

申请号：PCT/US2004/039518

申请日：2004-11-24

Applicant: NETWORK APPLIANCE, INC. ,  CORBETT, Peter, F. ,  ENGLISH, Robert, M. ,  KLEIMAN, Steven, R.

Inventor： CORBETT, Peter, F. ,  ENGLISH, Robert, M. ,  KLEIMAN, Steven, R.

IPC: G06N3/06

CPC classification number: G06F11/1076 ,  G06F2211/1057

Abstract: A uniform and symmetric, double failure-correcting technique protects against two or fewer disk failures in a disk array of a storage system. A RAID system of the storage system generates two disks worth of “redundant” information for storage in the array, wherein the redundant information (e.g., parity) is illustratively derived from computations along both diagonal parity sets (“diagonals”) and row parity sets (“rows”). Specifically, the RAID system computes row parity along rows of the array and diagonal parity along diagonals of the array. However, the contents of the redundant (parity) information disks interact such that neither disk contains purely (solely) diagonal or row redundancy information; the redundant information is generated using diagonal parity results in row parity computations (and vice versa).

Abstract translation: 统一和对称的双故障校正技术可保护存储系统的磁盘阵列中的两个或更少磁盘故障。 存储系统的RAID系统生成两个用于存储在阵列中的“冗余”信息的磁盘，其中冗余信息（例如，奇偶校验）被说明性地从两个对角奇偶校验集（“对角线”）和行奇偶校验集 （ “行”）。 具体来说，RAID系统沿着阵列的行和沿着阵列的对角线的对角线奇偶校验来计算行奇偶校验。 然而，冗余（奇偶校验）信息磁盘的内容相互作用，使得两个磁盘都不包含纯（单独）对角线或行冗余信息; 使用行奇偶校验计算中的对角奇偶校验结果生成冗余信息（反之亦然）。

公开(公告)号：WO2002029572A3

公开(公告)日：2002-04-11

申请号：PCT/US2001/031422

申请日：2001-10-04

Applicant: NETWORK APPLIANCE, INC.

Inventor： VISWANATHAN, Srinivasan ,  KLEIMAN, Steven, R.

IPC: G06F11/20

Abstract: The invention provides a method and system for recovery of file system data in file servers having mirrored file system volumes. The invention makes use of a "snapshot" feature of a robust file system (the "WAFL File System) to rapidly determine which of two or more mirrored volumes is most up-to-date, and which file blocks of the most recent mirrored volume have been changed from each one of the mirrored file systems. In a preferred embodiment, among a plurality of mirrored volumes, the invention rapidly determines which is the most up-to-date by examining a consistency point number maintained by the WAFL File System at each mirrored volume. The invention rapidly pairwise determines what blocks are shared between that most up-to-date mirrored volume and each other mirrored volume, in response to a snapshot of the file system maintained at each mirrored volume and are stored in common pairwise between each mirrored volume and the most up-to-date mirrored volume. The invention re synchronizes only those blocks that have been changed between the common snapshot and the most up-to-date snapshot.

公开(公告)号：EP1880271A2

公开(公告)日：2008-01-23

申请号：EP06751663.3

申请日：2006-04-27

Applicant: Network Appliance, Inc.

Inventor： CORBETT, Peter, F. ,  ENGLISH, Robert, M. ,  KLEIMAN, Steven, R.

IPC: G06F3/06

CPC classification number: G06F11/1096 ,  G06F3/0607 ,  G06F3/0632 ,  G06F3/0646 ,  G06F3/0689

Abstract: A technique places content, such as data, of one or more data containers on volumes of a striped volume set (SVS). The placement of data across the volumes of the SVS allows specification of a deterministic pattern of fixed length. That is, the pattern determines a placement of data of a data container that is striped among the volumes of the SVS. The placement pattern is such that the stripes are distributed exactly or nearly equally among the volumes and that, within any local span of a small multiple of the number of volumes, the stripes are distributed nearly equally among the volumes. The placement pattern is also substantially similar for a plurality of SVSs having different numbers of volumes.

公开(公告)号：EP1687707A2

公开(公告)日：2006-08-09

申请号：EP04812189.1

申请日：2004-11-24

Applicant: Network Appliance, Inc.

Inventor： CORBETT, Peter, F. ,  ENGLISH, Robert, M. ,  KLEIMAN, Steven, R.

IPC: G06F3/06

CPC classification number: G06F11/1096

Abstract: A semi-static distribution technique distributes parity across disks of an array. According to the technique, parity is distributed (assigned) across the disks of the array in a manner that maintains a fixed pattern of parity blocks among the stripes of the disks. When one or more disks are added to the array, the semi-static technique redistributes parity in a way that does not require recalculation of parity or moving of any data blocks. Notably, the parity information is not actually moved; the technique merely involves a change in the assignment (or reservation) for some of the parity blocks of each pre-existing disk to the newly added disk.

Abstract translation: 半静态分配技术在阵列的磁盘上分配奇偶校验。 根据该技术，奇偶校验以在盘的条带之间维持奇偶校验块的固定模式的方式分布（分配）在阵列的盘上。 当将一个或多个磁盘添加到阵列中时，半静态技术以不需要重新计算奇偶校验或移动任何数据块的方式重新分配奇偶校验。 值得注意的是，奇偶校验信息实际上没有被移动; 该技术仅涉及将每个预先存在的磁盘的一些奇偶校验块的分配（或预留）改变到新添加的磁盘。