公开(公告)号：WO2013036265A1

公开(公告)日：2013-03-14

申请号：PCT/US2011/055818

申请日：2011-10-11

Applicant: MICROSOFT CORPORATION

Inventor： MOSS, Darren ,  MEHRA, Karan ,  NAGAR, Rajeev ,  VERMA, Surendra ,  RAJPAL, Shiv

IPC: G06F12/00 ,  G06F9/06 ,  G06F11/08

CPC classification number: G06F11/1076 ,  G06F3/0613 ,  G06F3/0646 ,  G06F11/1471

Abstract: The storage of data sets in a storage set (e.g., data sets written to hard disk drives comprising a RAID array) may diminish the performance of storage set through non-sequential writes, particularly if storage devices promptly write data sets that are followed by sequentially following data sets. Additionally, storage sets may exhibit inconsistencies due to non-atomic writes of data sets and verifiers (e.g., checksums) and an intervening failure, such as an occurrence of the RAID write hole. Instead, data sets and verifiers may first be written to a stored on the nonvolatile media of a storage device before being committed to storage set. Such writes may be sequentially written to the journal, irrespective of the locations of data sets in the storage set; and recovery of a failure may simply involve re-committing the consistent records in the journal to correct incomplete writes to storage set.

Abstract translation: 将数据集存储在存储集中（例如，写入包含RAID阵列的硬盘驱动器的数据集）可能会通过非顺序写入来降低存储集的性能，特别是如果存储设备及时写入后续顺序的数据集， 以下数据集。 此外，由于数据集和验证器（例如，校验和）的非原子写入以及诸如RAID写入孔的发生的中间故障，存储器组可能表现出不一致。 相反，在提交到存储集之前，可以首先将数据集和验证器写入存储设备的非易失性介质上。 这种写入可以顺序地写入日志，而不管存储集中的数据集的位置如何; 并且恢复故障可能仅仅涉及在日志中重新提交一致的记录，以校正对存储集的不完整写入。

公开(公告)号：WO2014159362A1

公开(公告)日：2014-10-02

申请号：PCT/US2014/023219

申请日：2014-03-11

Applicant: MICROSOFT CORPORATION

Inventor： RAJPAL, Shiv ,  PANG, Juan-lee ,  HAVEWALA, Sarosh, Cyrus ,  VERMA, Surendra ,  MEHRA, Karan ,  MATTHEW, Bryan, Stephen ,  CHRISTIANSEN, Neal, Robert ,  HERRON, Andrew

IPC: G06F3/06

CPC classification number: G06F17/30091 ,  G06F3/0605 ,  G06F3/0643 ,  G06F3/0665 ,  G06F3/0685

Abstract: A system in which a file system may operate on a volume in which the logical address extent of the volume is divided into multiple tiers, each tier providing storage having a distinct trait set by mapping the logical addresses of the volume to appropriate underlying storage systems. A volume system exposes the volume to the file system in a manner that the file system itself has awareness of the tiers, and is aware of the trait sets of each tier. The file system may thus store file system namespaces (such as directories and files) into the tiers as appropriate for the file system namespace. A provisioning system may also be provided and be configured to provision the volume to include such tiers, and if desired, to extend the tiers.

Abstract translation: 文件系统可以在其中将卷的逻辑地址范围划分为多个层的卷上操作的系统，每个层通过将卷的逻辑地址映射到适当的底层存储系统来提供具有不同特征集的存储。 卷系统以文件系统本身对层级的认知方式将文件系统公开到文件系统，并且知道每个层的特征集合。 因此，文件系统可以将文件系统命名空间（诸如目录和文件）存储到适合于文件系统命名空间的层中。 还可以提供配置系统并将其配置为提供卷以包括这些层，并且如果需要，扩展层。

公开(公告)号：WO2014159424A1

公开(公告)日：2014-10-02

申请号：PCT/US2014/023599

申请日：2014-03-11

Applicant: MICROSOFT CORPORATION

Inventor： HERRON, Andrew ,  HAVEWALA, Sarosh Cyrus ,  MEHRA, Karan ,  KASTURIYA, Ankur ,  RAJPAL, Shiv

IPC: G06F3/06

CPC classification number: G06F12/02 ,  G06F3/0605 ,  G06F3/0631 ,  G06F3/0665 ,  G06F3/067 ,  G06F3/0689

Abstract: The provisioning of a volume that has multiple tiers corresponding to different trait sets. The volume to be provisioned is identified along with multiple tiers that are to be in the volume. For each of the tiers that are to be provisioned within the volume, a corresponding trait set is identified as to be applied to each tier. This corresponding trait set may be based on underlying storage systems that are available at the time of provisioning, or which are anticipated to be available. The volume is then caused to be provisioned with the corresponding tiers having the corresponding trait sets. Also, the provisioning of a file, which is determined to have one or more storage traits. Based on these storage traits, the file is then caused to be assigned to an appropriate tier.

Abstract translation: 配置具有对应于不同特征集的多个层的卷。 要配置的卷被标识，以及要在卷中的多个层。 对于要在卷中配置的每个层级，相应的特征集合被标识为应用于每个层。 该相应的特征集合可以基于在供应时可用的或预期可用的底层存储系统。 然后使体积与具有相应特征集的相应层次一起提供。 此外，文件的供应被确定为具有一个或多个存储特征。 基于这些存储特征，然后将该文件分配给适当的层。

公开(公告)号：WO2014159004A1

公开(公告)日：2014-10-02

申请号：PCT/US2014/021460

申请日：2014-03-07

Applicant: MICROSOFT CORPORATION

Inventor： MEHRA, Karan ,  HORTSCH, Erik G. ,  VERMA, Surendra

IPC: G06F11/10

CPC classification number: G06F11/1084 ,  G06F11/1088 ,  G06F17/30233

Abstract: Resiliency techniques for a virtual disk are described that enable user control over storage efficiency and recovery time. Configuration parameters for a virtual disk are obtained that indicate a number of available storage devices and a specified tolerance for storage device failures. A default configuration for the virtual disk that designates a default amount of redundancy data to store with client data to balance storage efficiency and recovery time is derived based on the configuration parameters. Options may then be provided to specify a custom configuration that changes the amount of redundancy data to customize the level of storage efficiency and recovery time. The virtual disk is configured and data is stored thereon in accordance with the default configuration or the custom configuration as directed by the user.

Abstract translation: 描述了虚拟磁盘的弹性技术，使用户能够控制存储效率和恢复时间。 获得虚拟磁盘的配置参数，指示可用存储设备的数量以及存储设备故障指定的容差。 基于配置参数，导出虚拟磁盘的默认配置，该配置指定与客户端数据一起存储的冗余数据的默认数量以平衡存储效率和恢复时间。 然后可以提供选项来指定修改冗余数据量的自定义配置，以定制存储效率和恢复时间级别。 配置虚拟磁盘并根据用户指导的默认配置或自定义配置来存储数据。

公开(公告)号：WO2013036254A1

公开(公告)日：2013-03-14

申请号：PCT/US2011/055581

申请日：2011-10-10

Applicant: MICROSOFT CORPORATION

Inventor： MEHRA, Karan ,  PALEOLOGU, Emanuel

IPC: G06F12/00 ,  G06F9/06

CPC classification number: G06F3/0605 ,  G06F3/0644 ,  G06F3/0689 ,  G06F9/5061

Abstract: A set of storage devices may interoperate to share a pool of storage space, such as in a Redundant Array of Inexpensive Disks (RAID) scheme. However, the details of the representation of the pool and allocation of capacity to the pool may enable advantages and/or impose limitations on the storage set. Presented herein are techniques for generating a representing a pooled partition on one or more storage devices featuring a pool configuration representing the pool as a set of spaces manifested by the pool; a set of storage devices sharing the pool; and a set of extents that map physical areas of the storage devices to logical areas of the spaces. The flexibility of these pooling techniques may enable such features as flexible capacity allocation, delayed binding, thin provisioning, and the participation of a storage device in two or more distinct pools shared with different sets of storage devices.

Abstract translation: 一组存储设备可以互操作以共享存储空间池，例如在冗余磁盘冗余阵列（RAID）方案中。 然而，池的表示细节和池的容量分配可能有利于和/或对存储集的限制。 这里提出的技术是在一个或多个存储设备上生成表示池化分区的技术，其特征在于将表示池的池配置作为由池显示的一组空间; 一组共享池的存储设备; 以及将存储设备的物理区域映射到空间的逻辑区域的一组盘区。 这些池化技术的灵活性可以实现诸如灵活容量分配，延迟绑定，精简配置以及存储设备参与与不同组存储设备共享的两个或多个不同池中的这些特征。

公开(公告)号：WO2009020978A2

公开(公告)日：2009-02-12

申请号：PCT/US2008/072248

申请日：2008-08-05

Applicant: MICROSOFT CORPORATION

Inventor： VANAMAMALAI, Thothathri ,  MEHRA, Karan ,  OLTEAN, Paul Adrian ,  DAS, Rajsekhar ,  KUSTERS, Norbert

IPC: G06F15/16 ,  G06F15/00

CPC classification number: G06F11/2074 ,  G06F11/2041 ,  G06F11/2048 ,  G06F17/30088

Abstract: Aspects of the subject matter described herein relate to sharing volume data via shadow copies. In aspects, an active computer creates a shadow copy of a volume. The shadow copy is exposed to one or more passive computers that may read but not write to the volume. A passive computer may obtain data from the shadow copy by determining whether the data has been written to a differential area and, if so, reading it from the differential area. If the data has not been written to the differential area, the passive computer may obtain it by first reading it from the volume, then re-determining whether it has been written to the differential area, and if so, reading the data from the differential area. Otherwise, the data read from the volume corresponds to the data needed for the shadow copy.

Abstract translation: 这里描述的主题的各方面涉及经由影子副本共享卷数据。 在某些方面，活动计算机会创建卷的卷影副本。 影子副本会暴露给一个或多个可以读取但不写入卷的被动计算机。 被动计算机可以通过确定数据是否已经写入差分区域，并且如果是，从差分区域读取数据，可以从影子副本获得数据。 如果数据没有写入差分区域，被动计算机可以通过首先从卷中读取数据，然后重新确定它是否写入差分区域来获取数据，如果是，则从差分读取数据 区。 否则，从卷读取的数据对应于卷影副本所需的数据。

公开(公告)号：WO2014204500A1

公开(公告)日：2014-12-24

申请号：PCT/US2013/060952

申请日：2013-09-20

Applicant: MICROSOFT CORPORATION

Inventor： LYAKHOVITSKIY, Grigory ,  MEHRA, Karan

IPC: G06F12/08 ,  G06F12/12 ,  G06F3/06

CPC classification number: G06F12/12 ,  G06F3/0611 ,  G06F3/0664 ,  G06F3/0685 ,  G06F12/0804 ,  G06F12/0868 ,  G06F12/121 ,  G06F2212/262

Abstract: Some implementations may include a virtual storage system to which data is written. The virtual storage system may include a cache and multiple hard drives. Multiple queues may be associated with the multiple hard drives such that each hard drive of the multiple hard drives has a corresponding queue of the multiple queues. A set of candidate rows may be selected from the cache. For each candidate row in the set of candidate rows, destination hard drives may be identified. Each candidate row may be placed in queues corresponding to the destination hard drives. Two or more candidate rows from the multiple queues may be written substantially contemporaneously (e.g., in parallel) to two or more destination hard drives.

Abstract translation: 一些实现可以包括写入数据的虚拟存储系统。 虚拟存储系统可以包括高速缓存和多个硬盘驱动器。 多个队列可以与多个硬盘驱动器相关联，使得多个硬盘驱动器的每个硬盘驱动器具有多个队列的相应队列。 可以从高速缓存中选择一组候选行。 对于候选行集合中的每个候选行，可以识别目的地硬盘驱动器。 每个候选行可以被放置在与目的地硬盘驱动器对应的队列中。 可以将多个队列中的两个或更多个候选行基本上同时（例如并行地）写入两个或多个目的地硬盘驱动器。

公开(公告)号：WO2014159003A1

公开(公告)日：2014-10-02

申请号：PCT/US2014/021459

申请日：2014-03-07

Applicant: MICROSOFT CORPORATION

Inventor： PALEOLOGU, Emanuel ,  RAJPAL, Shiv K. ,  MEHRA, Karan ,  VERMA, Surendra ,  KIRUBANANDAN, Nandagopal

IPC: G06F11/10 ,  G06F11/16

CPC classification number: G06F11/2056 ,  G06F11/1076 ,  G06F11/1088 ,  G06F11/1658 ,  G06F11/2046 ,  G06F11/2089 ,  G06F11/2094

Abstract: Techniques for recovery and redistribution of data from a virtual disk storage system are described herein. In one or more implementations, a storage scheme derived for a virtual disk configuration is configured to implement various recovery and redistribution designed to improve recovery performance. The storage scheme implements one or more allocation techniques to produce substantially uniform or nearly uniform distributions of data across physical storage devices associated with a virtual disk. The allocation facilitates concurrent regeneration and rebalancing operations for recovery of data in the event of failures. Additionally, the storage scheme is configured to implements parallelization techniques to perform the concurrent operations including but not limited to controlling multiple parallel read/writes during recovery.

Abstract translation: 本文描述了用于从虚拟磁盘存储系统恢复和重新分发数据的技术。 在一个或多个实现中，为虚拟磁盘配置导出的存储方案被配置为实现旨在提高恢复性能的各种恢复和再分配。 存储方案实现一种或多种分配技术以在与虚拟盘相关联的物理存储设备上产生数据的基本统一或几乎均匀的分布。 该分配有助于并发再生和重新平衡操作，以便在发生故障时恢复数据。 此外，存储方案被配置为实现并行化技术来执行并行操作，包括但不限于在恢复期间控制多个并行读/写。

公开(公告)号：WO2014158213A1

公开(公告)日：2014-10-02

申请号：PCT/US2013/058834

申请日：2013-09-09

Applicant: MICROSOFT CORPORATION

Inventor： GARSON, Matt ,  CHRISTIANSEN, Neal ,  HAVEWALA, Sarosh ,  RAJPAL, Shiv ,  MEHRA, Karan ,  VERMA, Surendra ,  CHAN, Daniel

IPC: G06F3/06

CPC classification number: G06F3/0619 ,  G06F3/0608 ,  G06F3/0631 ,  G06F3/0643 ,  G06F3/0665 ,  G06F3/067 ,  G06F3/0683 ,  G06F12/02 ,  G06F12/023 ,  G06F12/08 ,  G06F17/30138

Abstract: A thinly provisioned storage system detects whether physical storage capacity is available when there is a request to allocate storage capacity, prior to data being written to the storage system. In particular, at the time when the file system allocates storage, such as when creating a file or performing an extending write (append) operation, allocating storage to an unallocated region of a sparse file, defragmenting a file, and the like, a storage system can verify that actual physical storage capacity is available. Thus, if there is insufficient actual physical capacity at the time when a storage allocation is attempted, then an error message can be sent and remedial action can be taken.

Abstract translation: 在数据被写入存储系统之前，当存在分配存储容量的请求时，精简配置的存储系统检测物理存储容量是否可用。 特别地，在文件系统分配存储时，例如在创建文件或执行扩展写（附加）操作时，将分配存储到稀疏文件的未分配区域，对文件进行碎片整理等等，存储器 系统可以验证实际物理存储容量是否可用。 因此，如果在尝试存储分配时实际物理容量不足，则可以发送错误消息并且可以采取补救措施。

公开(公告)号：WO2013039523A1

公开(公告)日：2013-03-21

申请号：PCT/US2011/055608

申请日：2011-10-10

Applicant: MICROSOFT CORPORATION

Inventor： MEHRA, Karan

IPC: G06F12/00

CPC classification number: G06F11/2058 ,  G06F3/0605 ,  G06F3/0619 ,  G06F3/0644 ,  G06F3/0665 ,  G06F3/0689 ,  G06F11/1451

Abstract: The storage devices of a storage device set (e.g., a RAID array) may generate a nonvolatile representation of the configuration of the storage device set, including logical disks, spaces, storage pools, and layout and provisioning plans, on the physical media of the storage devices. A computer accessing the storage device set may also generate volatile memory representation of the storage device set to use while accessing the storage devices; however, the nonvolatile representation may not be performant due to its different usage and characteristics. Presented herein are techniques for accessing the storage device set according to volatile memory representation comprising a hierarchy of logical disks, slabs, and extents, and an accessor comprising a provisioning component that handles slab accesses while applying provisioning plans, and that interfaces with a lower-level layout component that translates slab accesses into storage device accesses while applying layout plans to the storage device set.

Abstract translation: 存储设备集合的存储设备（例如，RAID阵列）可以在存储设备集合的物理介质上生成包括逻辑磁盘，空间，存储池以及布局和供应计划的存储设备组的非易失性表示 存储设备。 访问存储设备组的计算机还可以在访问存储设备的同时生成设置为使用的存储设备的易失性存储器表示; 然而，由于其不同的使用和特性，非易失性表示可能不具有性能。 这里提出的是根据包括逻辑磁盘，板和扩展区的层次结构的易失性存储器表示访问存储设备组的技术，以及包括在应用供应计划时处理板访问的供应组件的存取器， 级别布局组件，将平板访问转换为存储设备访问，同时将布局计划应用于存储设备集。