公开(公告)号：US10013311B2

公开(公告)日：2018-07-03

申请号：US15166600

申请日：2016-05-27

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Bharat Baddepudi ,  Jeffrey S. Kimmel ,  T. Byron Rakitzis

IPC: G06F11/10 ,  G06F3/06 ,  G06F17/30 ,  G11C29/52

CPC classification number: G06F11/1084 ,  G06F3/0619 ,  G06F3/065 ,  G06F3/0653 ,  G06F3/0688 ,  G06F3/0689 ,  G06F11/1008 ,  G06F11/1068 ,  G06F11/1076 ,  G06F11/108 ,  G06F11/1092 ,  G06F11/1096 ,  G06F16/1847 ,  G06F2211/1057 ,  G11C29/52

Abstract: Embodiments described herein are directed to a file system driven RAID rebuild technique. A layered file system may organize storage of data as segments spanning one or more sets of storage devices, such as solid state drives (SSDs), of a storage array, wherein each set of SSDs may form a RAID group configured to provide data redundancy for a segment. The file system may then drive (i.e., initiate) rebuild of a RAID configuration of the SSDs on a segment-by-segment basis in response to cleaning of the segment (i.e., segment cleaning). Each segment may include one or more RAID stripes that provide a level of data redundancy (e.g., single parity RAID 5 or double parity RAID 6) as well as RAID organization (i.e., distribution of data and parity) for the segment. Notably, the level of data redundancy and RAID organization may differ among the segments of the array.

公开(公告)号：US09529546B2

公开(公告)日：2016-12-27

申请号：US14150689

申请日：2014-01-08

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Jeffrey S. Kimmel ,  Blake H. Lewis

IPC: G06F3/0484 ,  G06F3/06

CPC classification number: G06F3/0641 ,  G06F3/0604 ,  G06F3/0608 ,  G06F3/0643 ,  G06F3/067 ,  G06F3/0688 ,  G06F2003/0697

Abstract: In one embodiment, a layered file system includes a volume layer and an extent store layer configured to provide sequential log-structured layout of data and metadata on solid state drives (SSDs) of one or more storage arrays. The data is organized as variable-length extents of one or more logical units (LUNs). The metadata includes volume metadata mappings from offset ranges of a LUN to extent keys and extent metadata mappings of the extent keys to storage locations of the extents on the SSDs. The extent store layer maintaining the extent metadata mappings determines whether an extent is stored on a storage array, and, in response to determination that the extent is stored on the storage array, returns an extent key for the stored extent to the volume layer to enable global inline de-duplication that obviates writing a duplicate copy of the extent on the storage array.

Abstract translation: 在一个实施例中，分层文件系统包括卷层和盘区存储层，其被配置为在一个或多个存储阵列的固态驱动器（SSD）上提供数据和元数据的顺序日志结构布局。 数据被组织为一个或多个逻辑单元（LUN）的可变长度范围。 元数据包括从LUN的偏移范围到扩展密钥的卷元数据映射以及扩展密钥到SSD上的扩展区的存储位置的扩展元数据映射。 维护盘区元数据映射的盘区存储层确定盘区是否存储在存储阵列上，并且响应于确定盘区存储在存储阵列上，将存储的盘区的盘区密钥返回到卷层以启用 全局内联重复数据删除，从而避免在存储阵列上写入扩展区的重复副本。

公开(公告)号：US09367241B2

公开(公告)日：2016-06-14

申请号：US14854850

申请日：2015-09-15

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Bharat Baddepudi

IPC: G06F12/02 ,  G06F3/06 ,  G06F11/20

CPC classification number: G06F11/2069 ,  G06F3/0604 ,  G06F3/0619 ,  G06F3/0632 ,  G06F3/0634 ,  G06F3/065 ,  G06F3/0659 ,  G06F3/0689 ,  G06F11/2092 ,  G06F2201/805 ,  G06F2201/82

Abstract: In one embodiment, a node of a cluster is coupled to a storage array of storage devices. The node executes a storage input/output (I/O) stack having a redundant array of independent disks (RAID) layer that organizes the storage devices within the storage array as a plurality of RAID groups. Configuration information is stored as a cluster database. The configuration information identifies the RAID groups associated with the storage devices. Each RAID group is associated with a plurality of segments and each segment has a different RAID configuration.

Abstract translation: 在一个实施例中，集群的节点耦合到存储设备的存储阵列。 节点执行具有独立磁盘（RAID）层的冗余阵列的存储输入/输出（I / O）堆栈，其将存储阵列内的存储设备组织为多个RAID组。 配置信息存储为集群数据库。 配置信息标识与存储设备关联的RAID组。 每个RAID组与多个段相关联，并且每个段具有不同的RAID配置。

公开(公告)号：US20150227465A1

公开(公告)日：2015-08-13

申请号：US14695667

申请日：2015-04-24

Applicant: NetApp Inc.

Inventor： Rajesh Sundaram ,  Douglas Paul Doucette ,  David Grunwald ,  Jeffrey S. Kimmel ,  Ashish Prakash

IPC: G06F12/08 ,  G06F3/06

CPC classification number: G06F12/0866 ,  G06F3/0611 ,  G06F3/065 ,  G06F3/0656 ,  G06F3/068 ,  G06F3/0685 ,  G06F12/0802 ,  G06F2003/0691 ,  G06F2003/0692 ,  G06F2212/1024 ,  G06F2212/217 ,  G06F2212/222 ,  G06F2212/281

Abstract: Among other things, one or more techniques and/or systems are provided for storing data within a hybrid storage aggregate comprising a lower-latency storage tier and a higher-latency storage tier. In particular, frequently accessed data, randomly accessed data, and/or short lived data may be stored (e.g., read caching and/or write caching) within the lower-latency storage tier. Infrequently accessed data and/or sequentially accessed data may be stored within the higher-latency storage tier. Because the hybrid storage aggregate may comprise a single logical container derived from the higher-latency storage tier and the lower-latency storage tier, additional storage and/or file system functionality may be implemented across the storage tiers. For example, deduplication functionality, caching functionality, backup/restore functionality, and/or other functionality may be provided through a single file system (or other type of arrangement) and/or a cache map implemented within the hybrid storage aggregate.

Abstract translation: 除其他之外，提供一个或多个技术和/或系统用于在包括较低延迟存储层和较高延迟存储层的混合存储聚合中存储数据。 特别地，经常访问的数据，随机访问的数据和/或短寿命数据可以在较低延迟存储层内被存储（例如，读取高速缓存和/或写入高速缓存）。 不经常访问的数据和/或顺序访问的数据可以存储在更高延迟的存储层中。 因为混合存储聚合可以包括从较高延迟存储层和较低延迟存储层导出的单个逻辑容器，所以可以跨存储层实现附加的存储和/或文件系统功能。 例如，重复数据删除功能，缓存功能，备份/恢复功能和/或其他功能可以通过单个文件系统（或其他类型的安排）和/或在混合存储聚合中实现的缓存映射来提供。

公开(公告)号：US20150205663A1

公开(公告)日：2015-07-23

申请号：US14157828

申请日：2014-01-17

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Bharat Baddepudi ,  Jeffrey S. Kimmel

IPC: G06F11/10

CPC classification number: G06F11/108 ,  G06F11/2033 ,  G06F11/2035 ,  G06F11/2094 ,  G06F2211/1028

Abstract: In one embodiment, a node of a cluster having a plurality of nodes, executes a storage input/output (I/O) stack having a redundant array of independent disks (RAID) layer. The RAID layer organizes solid state drives (SSDs) within one or more storage arrays as a plurality of RAID groups associated with one or more extent stores. The RAID groups are formed from slices of storage spaces of the SSDs instead of entire storage spaces of the SSDs. This provides for RAID groups to co-exist on a same set of the SSDs.

Abstract translation: 在一个实施例中，具有多个节点的集群的节点执行具有独立磁盘冗余阵列（RAID）层的存储输入/输出（I / O）堆栈。 RAID层将一个或多个存储阵列中的固态驱动器（SSD）组织为与一个或多个扩展存储区相关联的多个RAID组。 RAID组由SSD的存储空间片而不是SSD的整个存储空间形成。 这提供了RAID组在同一组SSD上共存。

公开(公告)号：US08832363B1

公开(公告)日：2014-09-09

申请号：US14162047

申请日：2014-01-23

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Bharat Baddepudi ,  Jeffrey S. Kimmel

IPC: G06F12/16

CPC classification number: G06F11/108 ,  G06F11/2033 ,  G06F11/2035 ,  G06F11/2094 ,  G06F2211/1028

Abstract: In one embodiment, a clustered storage system is configured to reduce parity overhead of Redundant Array of Independent Disks (RAID) groups, as well as to facilitate distribution and servicing of the storage containers among storage systems (nodes) of the cluster. The storage containers may be stored on one or more storage arrays of storage devices, such as solid state drives (SSDs), connected to the nodes of the cluster. The RAID groups may be formed from slices (i.e., portions) of storage spaces of the SSDs instead of the entire storage spaces of the SSDs. That is, each RAID group may be formed “horizontally” across a set of SSDs as slices (i.e., one slice of storage space from each SSD in the set). Accordingly, a plurality of RAID groups may co-exist (i.e., be stacked) on the same set of SSDs.

Abstract translation: 在一个实施例中，集群存储系统被配置为减少独立磁盘冗余阵列（RAID）组的奇偶校验开销，并且便于在集群的存储系统（节点）之间的存储容器的分发和服务。 存储容器可以存储在连接到集群的节点的存储设备（例如固态驱动器（SSD））的一个或多个存储阵列上。 RAID组可以由SSD的存储空间的片（即，部分）而不是SSD的整个存储空间形成。 也就是说，每个RAID组可以作为切片（即，集合中的每个SSD的一个存储空间片）横跨一组SSD“水平地”形成。 因此，多个RAID组可以共存（即堆叠）在同一组SSD上。

公开(公告)号：US09619351B2

公开(公告)日：2017-04-11

申请号：US15143074

申请日：2016-04-29

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Bharat Baddepudi

IPC: G06F3/06 ,  G06F11/20

CPC classification number: G06F11/2069 ,  G06F3/0604 ,  G06F3/0619 ,  G06F3/0632 ,  G06F3/0634 ,  G06F3/065 ,  G06F3/0659 ,  G06F3/0689 ,  G06F11/2092 ,  G06F2201/805 ,  G06F2201/82

Abstract: In one embodiment, a node of a cluster is coupled to a storage array of storage devices. The node executes a storage input/output (I/O) stack having a redundant array of independent disks (RAID) layer that organizes the storage devices within the storage array as a plurality of RAID groups. Configuration information is stored as a cluster database. The configuration information identifies the RAID groups associated with the storage devices. Each RAID group is associated with a plurality of segments and each segment has a different RAID configuration.

公开(公告)号：US20160274973A1

公开(公告)日：2016-09-22

申请号：US15166600

申请日：2016-05-27

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Bharat Baddepudi ,  Jeffrey S. Kimmel ,  T. Byron Rakitzis

IPC: G06F11/10 ,  G11C29/52 ,  G06F17/30 ,  G06F3/06

CPC classification number: G06F11/1084 ,  G06F3/0619 ,  G06F3/065 ,  G06F3/0653 ,  G06F3/0688 ,  G06F3/0689 ,  G06F11/1008 ,  G06F11/1068 ,  G06F11/1076 ,  G06F11/108 ,  G06F11/1092 ,  G06F11/1096 ,  G06F17/30218 ,  G06F2211/1057 ,  G11C29/52

Abstract: Embodiments described herein are directed to a file system driven RAID rebuild technique. A layered file system may organize storage of data as segments spanning one or more sets of storage devices, such as solid state drives (SSDs), of a storage array, wherein each set of SSDs may form a RAID group configured to provide data redundancy for a segment. The file system may then drive (i.e., initiate) rebuild of a RAID configuration of the SSDs on a segment-by-segment basis in response to cleaning of the segment (i.e., segment cleaning). Each segment may include one or more RAID stripes that provide a level of data redundancy (e.g., single parity RAID 5 or double parity RAID 6) as well as RAID organization (i.e., distribution of data and parity) for the segment. Notably, the level of data redundancy and RAID organization may differ among the segments of the array.

Abstract translation: 本文描述的实施例涉及文件系统驱动的RAID重建技术。 分层文件系统可以将数据的存储组织为跨越存储阵列的一组或多组存储设备（例如固态驱动器（SSD））的段，其中每组SSD可以形成RAID组，其被配置为提供数据冗余 一段 然后文件系统可以响应于段的清除（即，段清除）逐个段地驱动（即，启动）重建SSD的RAID配置。 每个段可以包括一个或多个提供数据冗余级别（例如，单个奇偶校验RAID 5或双奇偶校验RAID 6）的RAID条带以及用于该段的RAID组织（即，数据和奇偶校验的分配）。 值得注意的是，数据冗余和RAID组织的级别可能在阵列的各个部分之间不同。

公开(公告)号：US09411514B2

公开(公告)日：2016-08-09

申请号：US14137084

申请日：2013-12-20

Applicant: NetApp, Inc.

Inventor： James Leong ,  Rajesh Sundaram ,  Douglas P. Doucette ,  Scott Schoenthal ,  Stephen H. Strange ,  Srinivasan Viswanathan

IPC: G06F3/06 ,  G06F9/48 ,  G06F11/20

CPC classification number: G06F3/0601 ,  G06F3/061 ,  G06F3/0611 ,  G06F3/0655 ,  G06F3/0659 ,  G06F3/0689 ,  G06F9/4881 ,  G06F11/2087

Abstract: A data access request to a file system is decomposed into a plurality of lower-level I/O tasks. A logical combination of physical storage components is represented as a hierarchical set of objects. A parent I/O task is generated from a first object in response to the data access request. A child I/O task is generated from a second object to implement a portion of the parent I/O task. The parent I/O task is suspended until the child I/O task completes. The child I/O task is executed in response to an occurrence of an event that a resource required by the child I/O task is available. The parent I/O task is resumed upon an event indicating completion of the child I/O task. Scheduling of any child I/O task is not conditional on execution of the parent I/O task, and a state diagram regulates the child I/O tasks.

公开(公告)号：US20160004447A1

公开(公告)日：2016-01-07

申请号：US14854850

申请日：2015-09-15

Applicant: NetApp, Inc.

Inventor： Rajesh Sundaram ,  Bharat Baddepudi

IPC: G06F3/06

CPC classification number: G06F11/2069 ,  G06F3/0604 ,  G06F3/0619 ,  G06F3/0632 ,  G06F3/0634 ,  G06F3/065 ,  G06F3/0659 ,  G06F3/0689 ,  G06F11/2092 ,  G06F2201/805 ,  G06F2201/82

Abstract: In one embodiment, a node of a cluster is coupled to a storage array of storage devices. The node executes a storage input/output (I/O) stack having a redundant array of independent disks (RAID) layer that organizes the storage devices within the storage array as a plurality of RAID groups. Configuration information is stored as a cluster database. The configuration information identifies the RAID groups associated with the storage devices. Each RAID group is associated with a plurality of segments and each segment has a different RAID configuration.

Abstract translation: 在一个实施例中，集群的节点耦合到存储设备的存储阵列。 节点执行具有独立磁盘（RAID）层的冗余阵列的存储输入/输出（I / O）堆栈，其将存储阵列内的存储设备组织为多个RAID组。 配置信息存储为集群数据库。 配置信息标识与存储设备关联的RAID组。 每个RAID组与多个段相关联，并且每个段具有不同的RAID配置。