公开(公告)号：US09304914B1

公开(公告)日：2016-04-05

申请号：US14038665

申请日：2013-09-26

Applicant: EMC Corporation

Inventor： Frederick Douglis ,  Windsor W. Hsu ,  Philip N. Shilane ,  Hyong Shim ,  Stephen Smaldone ,  Grant Wallace

IPC: G06F13/12 ,  G06F12/08

CPC classification number: G06F12/0802 ,  G06F12/0871 ,  G06F2212/313 ,  G06F2212/463

Abstract: A computer-implemented method for caching content in a cache memory device is disclosed. The method starts with receiving a request for accessing a first data block associated with a first file, and a file manager provides access of the first data block in a persistent storage device of a storage system. The file manager then caches the first data block in a cache memory device including deduplicating the first data block, wherein at least some of data blocks stored in the cache memory device are deduplicated data blocks, and wherein at least one of the data blocks is referenced by different regions of an identical file or different files.

Abstract translation: 公开了一种用于在高速缓冲存储器件中缓存内容的计算机实现的方法。 该方法从接收到访问与第一文件相关联的第一数据块的请求开始，并且文件管理器提供对存储系统的持久存储设备中的第一数据块的访问。 文件管理器然后将第一数据块高速缓存在高速缓冲存储器设备中，包括重复数据删除第一数据块，其中存储在高速缓冲存储器设备中的至少一些数据块是重复数据删除的数据块，并且其中至少一个数据块被引用 由不同区域的相同文件或不同的文件。

公开(公告)号：US08935446B1

公开(公告)日：2015-01-13

申请号：US14038668

申请日：2013-09-26

Applicant: EMC Corporation

Inventor： Philip N. Shilane ,  Hyong Shim ,  Stephen Smaldone ,  Grant Wallace ,  Frederick Douglis ,  Cheng Li

IPC: G06F13/12 ,  G06F12/08 ,  G06F12/12

CPC classification number: G06F12/0871

Abstract: A computer-implemented method for indexing content stored in a cache memory device is disclosed. The method starts with in response to receiving a first request for caching a first file extent associated with a first file in a cache memory device, generating a first fingerprint based on content of the first file extent. Then the method continues with searching in a fingerprint index based on the first fingerprint to determine whether the first file extent has been stored in the cache memory. In response to determining that a fingerprint entry matching the first fingerprint is found, the method then continues with associating a first identifier identifying the first file extent and the first file with a storage location of the cache memory device obtained from the matching fingerprint entry, without storing the first file extent in the cache memory device.

Abstract translation: 公开了一种用于索引存储在高速缓冲存储器件中的内容的计算机实现的方法。 响应于接收到缓存与高速缓存存储器设备中的第一文件相关联的第一文件盘区的第一请求，基于第一文件盘区的内容生成第一指纹，开始该方法。 然后，该方法继续基于第一指纹在指纹索引中进行搜索，以确定第一文件范围是否已被存储在高速缓冲存储器中。 响应于确定找到与第一指纹匹配的指纹条目，然后该方法继续将识别第一文件盘区的第一标识符和第一文件与从匹配指纹条目获得的高速缓冲存储器装置的存储位置相关联，而没有 将第一文件盘区存储在高速缓冲存储器装置中。

公开(公告)号：US09880746B1

公开(公告)日：2018-01-30

申请号：US15222352

申请日：2016-07-28

Applicant: EMC Corporation

Inventor： Philip Shilane ,  Grant Wallace ,  Frederick Douglis

IPC: G06F15/16 ,  G06F3/06

CPC classification number: G06F3/061 ,  G06F3/0611 ,  G06F3/0619 ,  G06F3/0641 ,  G06F3/065 ,  G06F3/067 ,  G06F3/0685

Abstract: In response to a request from a client to store a data block in a storage system, the data block is segmented into a plurality of subblocks. Each of the plurality of subblocks is individually compressed into a compressed subblock. The compressed subblocks are packed into a compressed data block. The compressed data block having the individually compressed subblocks therein is stored in a persistent storage device. Metadata of the compressed data block is stored in an index entry in an index of the storage system, including storing subblock locators indicating locations of the compressed subblocks. Each of the subblocks can be individually accessed based on a corresponding subblock locator without having to access remaining subblocks.

公开(公告)号：US09430156B1

公开(公告)日：2016-08-30

申请号：US14303402

申请日：2014-06-12

Applicant: EMC Corporation

Inventor： Philip Shilane ,  Grant Wallace ,  Frederick Douglis

IPC: G06F15/167 ,  G06F3/06

CPC classification number: G06F3/061 ,  G06F3/0611 ,  G06F3/0619 ,  G06F3/0641 ,  G06F3/065 ,  G06F3/067 ,  G06F3/0685

Abstract: In response to a request for stored data, retrieving an index entry, based on an identifier of the requested data, corresponding to an indexed block of storage containing the requested data. The index entry includes a start location of an indexed storage block and sub-block locators that identify the start of one or more sub-blocks within the indexed storage block. The sub-block containing the requested data is determined and the corresponding sub-block locator is read to find the starting location of the sub-block. Without reading the entire indexed storage block, the sub-block may be read from the starting location of the sub-block, decompressed, and the decompressed requested data read from the sub-block may be transmitted to the client. In this way, fewer I/O operations are needed that read the requested data, and memory needed for storing index information is minimized.

Abstract translation: 响应于对存储数据的请求，基于所请求数据的标识符检索索引条目，对应于包含所请求数据的索引的存储块。 索引条目包括索引的存储块的开始位置和标识索引的存储块中的一个或多个子块的开始的子块定位符。 确定包含所请求数据的子块，并读取相应的子块定位符以找到子块的起始位置。 在不读取整个索引的存储块的情况下，可以从子块的起始位置读取子块，进行解压缩，并且从子块读取的解压缩的请求数据可以被发送到客户机。 以这种方式，读取所请求的数据需要较少的I / O操作，并且最小化存储索引信息所需的内存。

公开(公告)号：US09411815B1

公开(公告)日：2016-08-09

申请号：US14038628

申请日：2013-09-26

Applicant: EMC Corporation

Inventor： Guanlin Lu ,  Philip Shilane ,  Grant Wallace ,  Frederick Douglis ,  Nitin Garg

IPC: G06F17/00 ,  G06F7/00 ,  G06F17/30 ,  G06F11/14

CPC classification number: G06F17/30153 ,  G06F11/1446 ,  G06F11/1453 ,  G06F11/1469

Abstract: Techniques for improving data compression of a deduplicated storage system are described herein. According to one embodiment, the similarity of a plurality of data chunks stored in one or more first storage areas of the storage system is determined based on a plurality of sketches, each describing characteristics of one of the data chunks. The data chunks are grouped into a plurality of groups of similar data chunks based on the similarity of the data chunks. The groups of similar data chunks are compressed, such that similar data chunks are compressed close to each other.

Abstract translation: 本文描述了用于改进重复数据消除的存储系统的数据压缩的技术。 根据一个实施例，基于多个草图来确定存储在存储系统的一个或多个第一存储区域中的多个数据块的相似性，每个草图描述数据块之一的特征。 基于数据块的相似度，数据块被分组成多组相似的数据块。 类似的数据块的组被压缩，使得类似的数据块被彼此靠近地压缩。

公开(公告)号：US09189402B1

公开(公告)日：2015-11-17

申请号：US14038699

申请日：2013-09-26

Applicant: EMC Corporation

Inventor： Stephen Smaldone ,  Grant R. Wallace ,  Frederick Douglis ,  Philip N. Shilane ,  Hyong Shim

IPC: G06F12/08 ,  G06F12/12 ,  G11C7/10

CPC classification number: G06F12/0871 ,  G06F12/0808 ,  G06F12/121 ,  G06F12/123 ,  G06F2212/1016 ,  G06F2212/222 ,  G06F2212/313 ,  G06F2212/401 ,  G06F2212/463 ,  G11C7/1072

Abstract: A computer-implemented method for caching content in a cache memory device is disclosed. The method starts with receiving, at a cache manager, one or more data chunks to be cached in a cache memory device, where the one or more data chunks are retrieved from a persistent storage disk of a storage system in response to a read request of a region of a file. Then the one or more data chunks of a file extent is compressed using a predetermined compression algorithm, and the file extent is packed into a write-evict unit (WEU) maintained in a random-access memory (RAM) that has been open to store a plurality of file extents. In response to determining that the WEU is full, the cache manager writes the WEU from the RAM into the cache memory device.

Abstract translation: 公开了一种用于在高速缓冲存储器件中缓存内容的计算机实现的方法。 该方法开始于在高速缓存管理器处接收要缓存在高速缓冲存储器设备中的一个或多个数据块，其中响应于对存储系统的读取请求而从存储系统的永久存储盘检索一个或多个数据块 一个文件的区域。 然后使用预定的压缩算法来压缩文件盘区的一个或多个数据块，并且将文件盘区打包到维持在已经打开以存储的随机存取存储器（RAM）中的写入单元（WEU）中 多个文件盘区。 响应于确定WEU已满，高速缓存管理器将WEU从RAM写入缓存存储器设备。

公开(公告)号：US20140324796A1

公开(公告)日：2014-10-30

申请号：US14267733

申请日：2014-05-01

Applicant: EMC CORPORATION

Inventor： Frederick Douglis ,  Philip Shilane ,  R. Hugo Patterson

IPC: G06F17/30

CPC classification number: G06F16/1748 ,  G06F3/0608 ,  G06F3/0641 ,  G06F3/0689 ,  G06F16/137 ,  G06F16/1744

Abstract: A system for directing for storage comprises a processor and a memory. The processor is configured to determine a segment overlap for each of a plurality of nodes. The processor is further configured to determine a selected node of the plurality of nodes based at least in part on the segment overlap for each of the plurality of nodes and based at least in part on a selection criteria. The memory is coupled to the processor and configured to provide the processor with instructions.

Abstract translation: 用于引导存储的系统包括处理器和存储器。 处理器被配置为确定多个节点中的每一个的段重叠。 处理器还被配置为至少部分地基于多个节点中的每个节点的段重叠来确定多个节点中的选定节点，并且至少部分地基于选择标准。 存储器耦合到处理器并且被配置为向处理器提供指令。

公开(公告)号：US09390116B1

公开(公告)日：2016-07-12

申请号：US14038673

申请日：2013-09-26

Applicant: EMC Corporation

Inventor： Cheng Li ,  Philip N. Shilane ,  Hyong Shim ,  Stephen Smaldone ,  Grant Wallace ,  Frederick Douglis

IPC: G06F17/30

CPC classification number: G06F17/30336

Abstract: A computer-implemented method for indexing content stored in a cache memory device is disclosed. The method starts with maintaining a fingerprint index having a plurality of fingerprint entries, each mapping a fingerprint to a storage location of a cache memory device, where the cache memory device caches some of data blocks stored in a persistent storage device of a storage system, and where the fingerprint index is a partial index indexing a portion of data stored in the cache memory device. In response to receiving a request to insert a new fingerprint, the method continues with evicting one of the fingerprint entries according to a predetermined eviction algorithm and inserting the new fingerprint into the evicted fingerprint entry.

Abstract translation: 公开了一种用于索引存储在高速缓冲存储器件中的内容的计算机实现的方法。 该方法开始于维护具有多个指纹条目的指纹索引，每个指纹条目将指纹映射到高速缓冲存储器设备的存储位置，其中高速缓存存储器设备缓存存储在存储系统的持久存储设备中的一些数据块， 并且其中指纹索引是索引存储在高速缓冲存储器设备中的数据的一部分的部分索引。 响应于接收到插入新指纹的请求，该方法继续根据预定的逐出算法驱逐指纹条目中的一个，并将新指纹插入被驱逐的指纹条目。

公开(公告)号：US09367557B1

公开(公告)日：2016-06-14

申请号：US14038625

申请日：2013-09-26

Applicant: EMC Corporation

Inventor： Xing Lin ,  Frederick Douglis ,  Philip Shilane ,  Grant Wallace

IPC: G06F17/30

CPC classification number: G06F17/30153 ,  H03M7/3077

Abstract: Techniques for improving data compression of a storage system are described herein. According to one embodiment, a first sequence of data is partitioned into a plurality of data chunks in a first sequence order according to a predetermined chunking algorithm. The similarity of the data chunks is determined based on data patterns of the data chunks. The data chunks are reorganized into a second sequence order based on the similarity of the data chunks, the second sequence order being different from the first sequence order. The reorganized data chunks are compressed in the second sequence order into a second sequence of data, such that similar data chunks are stored and compressed together within the second sequence of data.

Abstract translation: 本文描述了用于改善存储系统的数据压缩的技术。 根据一个实施例，根据预定的分块算法，以第一序列顺序将第一数据序列划分为多个数据块。 基于数据块的数据模式确定数据块的相似度。 基于数据块的相似度，将第二序列顺序与第一序列顺序不同，将数据块重新组织成第二序列。 重新组织的数据块以第二序列顺序压缩成第二数据序列，使得类似的数据块在第二数据序列内被一起存储和压缩。