-
公开(公告)号:US20250086143A1
公开(公告)日:2025-03-13
申请号:US18465896
申请日:2023-09-12
Applicant: VMWare LLC
Inventor: Eric Knauft , Sriram Patil , Wenguang Wang , Abhay Kumar Jain , Maxime Austruy
Abstract: Workload-responsive segment cleaning of log structured filesystems (LFSs) is disclosed. When multiple independent LFSs overlap on spanning a set of storage disks (including non-volatile memory express storage), a global segment cleaner (GSC) for each disk coordinates the cleaning rates of the local segment cleaners (LSCs) for each LFS having a presence on that disk. LFSs send usage information to relevant GSCs that select usage thresholds to trigger cleaning and cleaning rates. When capacity fullness (e.g., segments having at least one used block) meets a threshold, segment cleaning is performed at a rate based on capacity fullness and an equilibrium cleaning rate. Cleaning rates speed up when storage is more full, to provide capacity for burst writing events, but slow down when less full, to reduce overhead burden. LFSs clean at the highest rate identified for every GSC's usage threshold an LFS meets.
-
公开(公告)号:US12248797B2
公开(公告)日:2025-03-11
申请号:US17346607
申请日:2021-06-14
Applicant: VMware LLC
Inventor: Enning Xiang , Wenguang Wang
Abstract: Linked clone read performance when retrieving data from a clone is improved at least by aggregating block mapping metadata efficiently. Primary metadata for a child clone maps a logical block address (LBA) for data in a data region of the child clone to a physical sector address (PSA) for data in the data region of the child clone. At least a portion of primary metadata for a parent clone of the child clone is copied into archival metadata for the child clone. In response to a read request, data is returned from the child clone, parent clone, or another ancestor of the child clone based on whether or not a read request LBA is within the primary metadata for the child clone, or within the archival metadata.
-
公开(公告)号:US12131021B2
公开(公告)日:2024-10-29
申请号:US17929204
申请日:2022-09-01
Applicant: VMware LLC
Inventor: Wenguang Wang , Jiaqi Zuo , Hardik Singh Negi , Eric Knauft , Junlong Gao
CPC classification number: G06F3/0604 , G06F3/0655 , G06F3/0673 , G06F16/2246 , G06F11/1446
Abstract: A method for efficient journal truncation is provided. A method for journal truncation includes maintaining a journal in a memory of a computing system including a plurality of records. Each record indicates a transaction in an ordered data structure. The method includes maintaining a truncation queue in the memory including one or more entries. Each entry in the truncation queue includes a physical on-disk offset associated with a different record of the plurality of records. The method includes determining to truncate the journal and truncating records, of the plurality of records, from the journal starting from a beginning record in the journal up to the record with the physical on-disk offset associated a least recent entry of the one or more entries in the truncation queue, where the truncating includes removing the records from the memory.
-
公开(公告)号:US12111795B2
公开(公告)日:2024-10-08
申请号:US17357044
申请日:2021-06-24
Applicant: VMware LLC
Inventor: Abhay Kumar Jain , Sriram Patil , Junlong Gao , Wenguang Wang
IPC: G06F7/00 , G06F16/16 , G06F16/17 , G06F16/174 , G06F16/178 , G06F16/182
CPC classification number: G06F16/1844 , G06F16/164 , G06F16/1734 , G06F16/1756 , G06F16/178
Abstract: A method for managing replication of cloned files is provided. Embodiments include determining, at a source system, that a first file has been cloned to create a second file. Embodiments include sending, from the source system to a replica system, an address of the first extent and an indication that a status of the first extent has changed from non-cloned to cloned. Embodiments include changing, at the replica system, a status of a second extent associated with a replica of the first file on the replica system from non-cloned to cloned and creating a mapping of the address of the first extent to an address of the second extent on the replica system. Embodiments include creating, at the replica system, a replica of the second file comprising a reference to the address of the second extent on the replica system.
-
公开(公告)号:US12111771B2
公开(公告)日:2024-10-08
申请号:US17384298
申请日:2021-07-23
Applicant: VMware LLC
Inventor: Enning Xiang , Wenguang Wang
IPC: G06F12/10
CPC classification number: G06F12/10 , G06F2212/657
Abstract: Linked clone read performance (e.g., retrieving data) is improved at least by minimizing the number of input/output (I/O) operations. For a child clone, a local logical extent and an inherited logical extent are generated. The local logical extent comprises a logical block address (LBA) for data in a data region of the child clone and a physical sector address (PSA) corresponding to the LBA for the data in the data region of the child clone. The inherited logical extent spans logical extents that are accessible to the child clone. The inherited logical extent comprises an LBA for data in a data region of an ancestor of the child clone and a corresponding identifier (ID) of the ancestor. Data for an LBA in a read request may be rapidly found in the child clone (local logical extent) or an ancestor (inherited logical extent).
-
公开(公告)号:US12056054B2
公开(公告)日:2024-08-06
申请号:US17900642
申请日:2022-08-31
Applicant: VMware LLC
Inventor: Wenguang Wang , Yanxing Pan , Junlong Gao , Mounesh Badiger , Eric Knauft , Vamsidhar Gunturu
IPC: G06F12/08 , G06F12/0864
CPC classification number: G06F12/0864 , G06F2212/1016 , G06F2212/604
Abstract: The disclosure describes growing a data cache using a background hash bucket growth process. A first memory portion is allocated to the data buffer of the data cache and a second memory portion is allocated to the metadata buffer of the data cache based on the cache growth instruction. The quantity of hash buckets in the hash bucket buffer is increased and the background hash bucket growth process is initiated, wherein the process is configured to rehash hash bucket entries of the hash bucket buffer in the increased quantity of hash buckets. A data entry is stored in the data buffer using the allocated first memory portion of the data cache and metadata associated with the data entry is stored using the allocated second memory portion of the metadata buffer, wherein a hash bucket entry associated with the data entry is stored in the increased quantity of hash buckets.
-
公开(公告)号:US20250103231A1
公开(公告)日:2025-03-27
申请号:US18471392
申请日:2023-09-21
Applicant: VMware LLC
Inventor: Ruiling Dou , Tao Xie , Zongliang Li , Asit Desai , Wenguang Wang , Litao Xia
IPC: G06F3/06
Abstract: The disclosure herein describes converting a disk cluster to a different format. A format conversion instruction associated with a disk cluster is received. A first subgroup of disks of the disk cluster that are the emptiest disks of the disk cluster are identified and all data is evacuated from the first subgroup of disks to other disks of the disk cluster. The first subgroup of disks is reformatted based on the received format conversion instruction. A group of data objects stored in the disk cluster is converted based on the format conversion instruction and the converted group of data objects are written to the reformatted first subgroup of disks. The process iterates through the disks of the disk cluster to reformat all disks and convert all data objects based on the received format conversion instruction. The process reduces the write operations required to convert the format of the disk cluster.
-
公开(公告)号:US12260105B1
公开(公告)日:2025-03-25
申请号:US18471392
申请日:2023-09-21
Applicant: VMware LLC
Inventor: Ruiling Dou , Tao Xie , Zongliang Li , Asit Desai , Wenguang Wang , Litao Xia
IPC: G06F3/06
Abstract: The disclosure herein describes converting a disk cluster to a different format. A format conversion instruction associated with a disk cluster is received. A first subgroup of disks of the disk cluster that are the emptiest disks of the disk cluster are identified and all data is evacuated from the first subgroup of disks to other disks of the disk cluster. The first subgroup of disks is reformatted based on the received format conversion instruction. A group of data objects stored in the disk cluster is converted based on the format conversion instruction and the converted group of data objects are written to the reformatted first subgroup of disks. The process iterates through the disks of the disk cluster to reformat all disks and convert all data objects based on the received format conversion instruction. The process reduces the write operations required to convert the format of the disk cluster.
-
公开(公告)号:US12189574B2
公开(公告)日:2025-01-07
申请号:US17504845
申请日:2021-10-19
Applicant: VMware LLC
Inventor: Enning Xiang , Wenguang Wang , Abhay Kumar Jain , Sriram Patil , Asit Desai , Eric Knauft
IPC: G06F16/11 , G06F12/02 , G06F16/182 , G06F16/22
Abstract: Example methods and systems for accessing data in a log-structured file system having a plurality of snapshots of storage objects backed by a first-level copy-on-write (COW) B+ tree data structure and a plurality of second-level B+ tree data structures have been disclosed. One example method includes obtaining a first first-level mapping associated with a first snapshot from the plurality of snapshots based on a first logical block address, wherein each of the plurality of snapshots corresponds to each of the plurality of second-level B+ tree data structures, identifying a first second-level B+ tree data structure corresponding to one of the plurality of snapshots based on the first first-level mapping, obtaining a first second-level mapping based on the first logical block address in the first second-level B+ tree data structure, obtaining a first physical block address based on the first second-level mapping, and accessing data at the first physical block address.
-
公开(公告)号:US11960450B2
公开(公告)日:2024-04-16
申请号:US16999994
申请日:2020-08-21
Applicant: VMware LLC
Inventor: Wenguang Wang , Ilia Langouev , Vamsi Gunturu , Junlong Gao
IPC: G06F16/174 , G06F9/455 , G06F16/11 , G06F16/188
CPC classification number: G06F16/1752 , G06F9/45558 , G06F16/116 , G06F16/188 , G06F2009/45583
Abstract: The efficiency of segment cleaning for a log-structured file system (LFS) is enhanced at least by storing additional information in a segment usage table (SUT). Live blocks (representing portions of stored objects) in an LFS are determined based at least on the SUT. Chunk identifiers associated with the live blocks are read. The live blocks are coalesced at least by writing at least a portion of the live blocks into at least one new segment. A blind update of at least a portion of the chunk identifiers in a chunk map is performed to indicate the new segment. The blind update includes writing to the chunk map without reading from the chunk map. In some examples, the objects comprise virtual machine disks (VMDKs) and the SUT changes between a list format and a bitmap format, to minimize size.
-
-
-
-
-
-
-
-
-