-
公开(公告)号:US11500566B2
公开(公告)日:2022-11-15
申请号:US17153674
申请日:2021-01-20
Applicant: Commvault Systems, Inc.
Inventor: Bharat Pundalik Naik , Xiangyu Wang , Avinash Lakshman
IPC: G06F3/06 , H04L29/08 , H04L67/1097
Abstract: Disclosed deduplication techniques at a distributed data storage system guarantee that space reclamation will not affect deduplicated data integrity even without perfect synchronization between components. By understanding certain “behavioral” characteristics and schedule cadences of backup operations that generate backup copies received at the distributed data storage system, data blocks that are not re-written by subsequent backup copies are pro-actively aged, while promoting continued retention of data blocks that are re-written. An expiry scheme operates with block-level granularity. Each unique deduplicated data block is given an expiry timeframe based on the block's arrival time at the distributed data storage system (i.e., when a backup copy supplies the block) and further based on backup frequencies of the various virtual disks referencing a unique system-wide identifier of the block, which is based on the block's hash value. Communications between components are kept to an as-needed basis. Cloud-based and multi-cloud configurations are disclosed.
-
公开(公告)号:US11487468B2
公开(公告)日:2022-11-01
申请号:US17336081
申请日:2021-06-01
Applicant: Commvault Systems, Inc.
Inventor: Suhani Gupta , Avinash Lakshman , Anand Vishwanath Vastrad , Srinivas Lakshman
Abstract: A distributed data storage system using erasure coding (EC) provides advantages of EC data storage while retaining high resiliency for EC data storage architectures having fewer data storage nodes than the number of EC data-plus-parity fragments. To ameliorate the effects of certain storage node outages or fatal disk failures, incoming data is temporarily replicated so that read and write operations can continue from/to the storage system. The system automatically heals failed EC write attempts in a manner transparent to users and/or applications: when all storage nodes are operational, the distributed data storage system automatically converts the temporarily replicated data to EC storage and reclaims storage space previously used by the temporarily replicated data. Individual hardware failures are healed through migration techniques that reconstruct and re-fragment data blocks according to the governing EC scheme. An illustrative embodiment is a three-node data storage system using EC 4+2.
-
公开(公告)号:US11340672B2
公开(公告)日:2022-05-24
申请号:US16848799
申请日:2020-04-14
Applicant: Commvault Systems, Inc.
Inventor: Avinash Lakshman , Abhijith Shenoy
Abstract: An application within a virtual machine is an iSCSI Initiator and is allowed to use as an iSCSI Target another virtual machine within the same hypervisor in order to make a persistent reservation for a virtual disk within a remotely-located storage platform. Any number of virtual machines within different hypervisors, and perhaps on different computers, use a local controller virtual machine to make a persistent reservation for the same virtual disk. The registration list and the current reservation holder data for an iSCSI persistent reservation for a particular virtual disk are held on a storage node of the storage platform rather than within a single virtual machine of a remote computer. A metadata module on the storage platform handles the incoming requests. A coordinator module within the storage platform uses a lock mechanism to guarantee that the reserve, release, preempt and clear commands are handled properly.
-
公开(公告)号:US20200334207A1
公开(公告)日:2020-10-22
申请号:US16919721
申请日:2020-07-02
Applicant: Commvault Systems, Inc.
Inventor: Avinash Lakshman , Lasaro Camargos , Deepak JAIN
IPC: G06F16/178 , G06F16/2457 , G06F16/13 , G06F16/2458 , G06F11/14
Abstract: A client machine writes to and reads from a virtual disk on a remote storage platform. Metadata is generated and stored in replicas on different metadata nodes of the storage platform. A modified log-structured merge tree is used to store and compact string-sorted tables of metadata. During file storage and compaction, a consistent file identification scheme is used across all metadata nodes. A fingerprint file is calculated for each SST (metadata) file on disk that includes hash values corresponding to regions of the SST file. To synchronize, the fingerprint files of two SST files are compared, and if any hash values are missing from a fingerprint file then the key-value-timestamp triples corresponding to these missing hash values are sent to the SST file that is missing them. The SST file is compacted with the missing triples to create a new version of the SST file. The synchronization is bi-directional.
-
公开(公告)号:US10795577B2
公开(公告)日:2020-10-06
申请号:US15156015
申请日:2016-05-16
Applicant: Commvault Systems, Inc.
Inventor: Avinash Lakshman , Gaurav Yadav
Abstract: A computer receives a write request including an offset within a virtual disk. The computer writes the data block to a remote platform and calculates a hash value of the data. If the hash value does not exist in a first table of a block cache of the computer, the computer adds a pair to the first table: hash value/block cache data offset. Next, the computer adds a pair in a second table of the block cache: virtual disk offset of the data/hash value. A read request uses these tables to find the data in the cache without accessing the platform. The read consults the second table to find the hash value corresponding to the virtual disk offset of the block. The hash value is a key into the first table to find the block cache data offset of the data; the data is read from the cache.
-
公开(公告)号:US10691187B2
公开(公告)日:2020-06-23
申请号:US16274014
申请日:2019-02-12
Applicant: Commvault Systems, Inc.
Inventor: Avinash Lakshman , Abhijith Shenoy
Abstract: An application within a virtual machine is an iSCSI Initiator and is allowed to use as an iSCSI Target another virtual machine within the same hypervisor in order to make a persistent reservation for a virtual disk within a remotely-located storage platform. Any number of virtual machines within different hypervisors, and perhaps on different computers, use a local controller virtual machine to make a persistent reservation for the same virtual disk. The registration list and the current reservation holder data for an iSCSI persistent reservation for a particular virtual disk are held on a storage node of the storage platform rather than within a single virtual machine of a remote computer. A metadata module on the storage platform handles the incoming requests. A coordinator module within the storage platform uses a lock mechanism to guarantee that the reserve, release, preempt and clear commands are handled properly.
-
27.
公开(公告)号:US12294622B2
公开(公告)日:2025-05-06
申请号:US18654088
申请日:2024-05-03
Applicant: Commvault Systems, Inc.
Inventor: Lasaro Camargos , Bharat Pundalik Naik , Avinash Lakshman , Deepak Jain
IPC: G06F15/173 , G06F9/455 , G06F11/14 , G06F16/182 , G06F16/23 , G06F18/25 , G06V10/25 , G06V10/34 , G06V20/54 , G06V20/59 , G06V40/10 , H04L67/104 , H04N7/18 , H04N23/56 , H04N23/66
Abstract: In a running distributed data storage system that actively processes I/Os, metadata nodes are commissioned and decommissioned without taking down the storage system and without introducing interruptions to metadata or payload data I/O. The inflow of reads and writes continues without interruption even while new metadata nodes are in the process of being added and/or removed and the strong consistency of the system is guaranteed. Commissioning and decommissioning nodes within the running system enables streamlined replacement of permanently failed nodes and advantageously enables the system to adapt elastically to workload changes. An illustrative distributed barrier logic (the “view change barrier”) controls a multi-state process that controls a coordinated step-wise progression of the metadata nodes from an old view to a new normal. Rules for I/O handling govern each state until the state machine loop has been traversed and the system reaches its new normal.
-
28.
公开(公告)号:US12063270B2
公开(公告)日:2024-08-13
申请号:US18128499
申请日:2023-03-30
Applicant: Commvault Systems, Inc.
Inventor: Lásaro Camargos , Deepak Jain , Avinash Lakshman , Bharat Pundalik Naik
IPC: G06F15/173 , G06F9/455 , G06F11/14 , G06F16/182 , G06F16/23 , G06F18/25 , G06V10/25 , G06V10/34 , G06V20/54 , G06V20/59 , G06V40/10 , H04L67/104 , H04N7/18 , H04N23/56 , H04N23/66
CPC classification number: H04L67/1046 , G06F9/45558 , G06F11/1425 , G06F16/182 , G06F16/2365 , G06F18/251 , G06V10/25 , G06V10/34 , G06V20/54 , G06V20/59 , G06V40/10 , G06V40/103 , H04L67/1048 , H04N7/181 , H04N7/188 , H04N23/56 , H04N23/66 , G06F2009/45583 , G06V2201/08
Abstract: In a running distributed data storage system that actively processes I/Os, metadata nodes are commissioned and decommissioned without taking down the storage system and without introducing interruptions to metadata or payload data I/O. The inflow of reads and writes continues without interruption even while new metadata nodes are in the process of being added and/or removed and the strong consistency of the system is guaranteed. Commissioning and decommissioning nodes within the running system enables streamlined replacement of permanently failed nodes and advantageously enables the system to adapt elastically to workload changes. An illustrative distributed barrier logic (the “view change barrier”) controls a multi-state process that controls a coordinated step-wise progression of the metadata nodes from an old view to a new normal. Rules for I/O handling govern each state until the state machine loop has been traversed and the system reaches its new normal.
-
公开(公告)号:US20230325124A1
公开(公告)日:2023-10-12
申请号:US18205448
申请日:2023-06-02
Applicant: Commvault Systems, Inc.
Inventor: Avinash Lakshman , Gaurav Yadav
IPC: G06F3/06
CPC classification number: G06F3/0664 , G06F3/0608 , G06F3/0641 , G06F3/0683
Abstract: In order to avoid writing duplicates of blocks of data into a storage platform, any virtual disk within the storage platform may have a de-duplication feature enabled. Or, all virtual disks have this feature enabled. For virtual disks with de-duplication enabled, a unique message digest is calculated for every block of data written to that virtual disk. Upon a write, these message digests are consulted in order to determine if a particular block of data has already been written, if so, it is not written again, and if not, it is written. All de-duplication virtual disks are written to a single system virtual disk within the storage platform. De-duplication occurs over the entire storage platform and over all its virtual disks because all message digests are consulted before a write is performed for any virtual disk. A read for a de-duplication virtual desk reads from the system virtual disk.
-
30.
公开(公告)号:US20230308507A1
公开(公告)日:2023-09-28
申请号:US18128499
申请日:2023-03-30
Applicant: Commvault Systems, Inc.
Inventor: Lásaro Camargos , Deepak Jain , Avinash Lakshman , Bharat Pundalik Naik
IPC: H04L67/104 , G06F9/455 , G06F11/14 , G06F16/182 , G06F16/23
CPC classification number: H04L67/1046 , G06F9/45558 , G06F11/1425 , G06F16/182 , G06F16/2365 , H04L67/1048 , G06F2009/45583
Abstract: In a running distributed data storage system that actively processes I/Os, metadata nodes are commissioned and decommissioned without taking down the storage system and without introducing interruptions to metadata or payload data I/O. The inflow of reads and writes continues without interruption even while new metadata nodes are in the process of being added and/or removed and the strong consistency of the system is guaranteed. Commissioning and decommissioning nodes within the running system enables streamlined replacement of permanently failed nodes and advantageously enables the system to adapt elastically to workload changes. An illustrative distributed barrier logic (the “view change barrier”) controls a multi-state process that controls a coordinated step-wise progression of the metadata nodes from an old view to a new normal. Rules for I/O handling govern each state until the state machine loop has been traversed and the system reaches its new normal.
-
-
-
-
-
-
-
-
-