公开(公告)号：US11934356B2

公开(公告)日：2024-03-19

申请号：US17708312

申请日：2022-03-30

Applicant: Commvault Systems, Inc.

Inventor： Avinash Lakshman ,  Lasaro Camargos ,  Deepak Jain

IPC: G06F7/00 ,  G06F11/14 ,  G06F16/13 ,  G06F16/178 ,  G06F16/2457 ,  G06F16/2458 ,  G06F17/00 ,  G06F16/182 ,  G06F16/27

CPC classification number: G06F16/178 ,  G06F11/1464 ,  G06F16/137 ,  G06F16/24573 ,  G06F16/2471 ,  G06F16/182 ,  G06F16/275

Abstract: A client machine writes to and reads from a virtual disk on a remote storage platform. Metadata is generated and stored in replicas on different metadata nodes of the storage platform. A modified log-structured merge tree is used to store and compact string-sorted tables of metadata. During file storage and compaction, a consistent file identification scheme is used across all metadata nodes. A fingerprint file is calculated for each SST (metadata) file on disk that includes hash values corresponding to regions of the SST file. To synchronize, the fingerprint files of two SST files are compared, and if any hash values are missing from a fingerprint file, then the key-value-timestamp triples corresponding to these missing hash values are sent to the SST file that is missing them. The SST file is compacted with the missing triples to create a new version of the SST file. The synchronization is bi-directional.

公开(公告)号：US11614883B2

公开(公告)日：2023-03-28

申请号：US17336103

申请日：2021-06-01

Applicant: Commvault Systems, Inc.

Inventor： Anand Vishwanath Vastrad ,  Avinash Lakshman ,  Suhani Gupta ,  Srinivas Lakshman

IPC: G06F3/06

Abstract: A distributed data storage system using erasure coding (EC) provides advantages of EC data storage while retaining high resiliency for EC data storage architectures having fewer data storage nodes than the number of EC data-plus-parity fragments. An illustrative embodiment is a three-node data storage system with EC 4+2. Incoming data is temporarily replicated to ameliorate the effects of certain storage node outages or fatal disk failures, so that read and write operations can continue from/to the storage system. The system is equipped to automatically heal failed EC write attempts in a manner transparent to users and/or applications: when all storage nodes are operational, the distributed data storage system automatically converts the temporarily replicated data to EC storage and reclaims storage space previously used by the temporarily replicated data. Individual hardware failures are healed through migration techniques that reconstruct and re-fragment data blocks according to the governing EC scheme.

公开(公告)号：US11570243B2

公开(公告)日：2023-01-31

申请号：US17465691

申请日：2021-09-02

Applicant: Commvault Systems, Inc.

Inventor： Lásaro Camargos ,  Deepak Jain ,  Avinash Lakshman ,  Bharat Pundalik Naik

IPC: G06F16/182 ,  G06F16/23 ,  H04L67/104 ,  G06F9/455 ,  G06F11/14

Abstract: In a running distributed data storage system that actively processes I/Os, metadata nodes are commissioned and decommissioned without taking down the storage system and without introducing interruptions to metadata or payload data I/O. The inflow of reads and writes continues without interruption even while new metadata nodes are in the process of being added and/or removed and the strong consistency of the system is guaranteed. Commissioning and decommissioning nodes within the running system enables streamlined replacement of permanently failed nodes and advantageously enables the system to adapt elastically to workload changes. An illustrative distributed barrier logic (the “view change barrier”) controls a multi-state process that controls a coordinated step-wise progression of the metadata nodes from an old view to a new normal. Rules for I/O handling govern each state until the state machine loop has been traversed and the system reaches its new normal.

公开(公告)号：US11470056B2

公开(公告)日：2022-10-11

申请号：US17066316

申请日：2020-10-08

Applicant: Commvault Systems, Inc.

Inventor： Avinash Lakshman ,  Swathi Hrishikesh

IPC: H04L9/40 ,  G06F9/455 ,  H04L67/1097

Abstract: Encryption of data occurs before it is written to the storage platform; decryption occurs after it is read from the storage platform on a computer separate from the storage platform. By encrypting data before it travels over a wide-area network to a storage platform (and by only decrypting that data once it has arrived at an enterprise from the storage platform), we address data security over the network. Application data is encrypted at the virtual disk level before it leaves a controller virtual machine, and is only decrypted at that controller virtual machine after being received from the storage platform. Encryption and decryption of data is compatible with other services of the storage system such as de-duplication. Any number of key management services can be used in a transparent manner.

公开(公告)号：US11314687B2

公开(公告)日：2022-04-26

申请号：US17179160

申请日：2021-02-18

Applicant: Commvault Systems, Inc.

Inventor： Srividhya Kavaipatti Anantharamakrishnan ,  Lásaro Camargos ,  Abhijith Shenoy ,  Xiangyu Wang ,  Avinash Lakshman ,  Srinivas Lakshman

IPC: G06F16/11 ,  G06F16/182

Abstract: A distributed data storage system comprises features for integration with application orchestrators such as Kubernetes, and includes a proprietary Container Storage Interface (CSI) driver. Features include setting snapshot scheduling and retention policies, and a “container data mover” that replicates data from a source to a distinct destination distributed data storage system. The migration may be configured one-to-one, one-to-many, unidirectional, and/or bi-directional. Metadata-based snapshots and metadata-based changed block tracking identify payload data to move from source to destination within application orchestrator frameworks at both ends. Payload data is migrated from source to destination using different techniques than those used for migrating metadata, e.g., kernel-to-kernel for copying payload data versus ordinary metadata writes. An illustrative barrier logic ensures that the migration follows a controlled progression of operations.

公开(公告)号：US20210029095A1

公开(公告)日：2021-01-28

申请号：US17066316

申请日：2020-10-08

Applicant: Commvault Systems, Inc.

Inventor： Avinash Lakshman ,  Swathi Hrishikesh

IPC: H04L29/06 ,  G06F9/455 ,  H04L29/08

Abstract: Encryption of data occurs before it is written to the storage platform; decryption occurs after it is read from the storage platform on a computer separate from the storage platform. By encrypting data before it travels over a wide-area network to a storage platform (and by only decrypting that data once it has arrived at an enterprise from the storage platform), we address data security over the network. Application data is encrypted at the virtual disk level before it leaves a controller virtual machine, and is only decrypted at that controller virtual machine after being received from the storage platform. Encryption and decryption of data is compatible with other services of the storage system such as de-duplication. Any number of key management services can be used in a transparent manner.

公开(公告)号：US12050806B2

公开(公告)日：2024-07-30

申请号：US18112078

申请日：2023-02-21

Applicant: Commvault Systems, Inc.

Inventor： Anand Vishwanath Vastrad ,  Avinash Lakshman ,  Suhani Gupta ,  Srinivas Lakshman

IPC: G06F3/06

CPC classification number: G06F3/0655 ,  G06F3/0604 ,  G06F3/0619 ,  G06F3/064 ,  G06F3/065 ,  G06F3/0652 ,  G06F3/0664 ,  G06F3/067

Abstract: A distributed data storage system using erasure coding (EC) provides advantages of EC data storage while retaining high resiliency for EC data storage architectures having fewer data storage nodes than the number of EC data-plus-parity fragments. An illustrative embodiment is a three-node data storage system with EC 4+2. Incoming data is temporarily replicated to ameliorate the effects of certain storage node outages or fatal disk failures, so that read and write operations can continue from/to the storage system. The system is equipped to automatically heal failed EC write attempts in a manner transparent to users and/or applications: when all storage nodes are operational, the distributed data storage system automatically converts the temporarily replicated data to EC storage and reclaims storage space previously used by the temporarily replicated data. Individual hardware failures are healed through migration techniques that reconstruct and re-fragment data blocks according to the governing EC scheme.

公开(公告)号：US11916886B2

公开(公告)日：2024-02-27

申请号：US17941929

申请日：2022-09-09

Applicant: Commvault Systems, Inc.

Inventor： Avinash Lakshman ,  Swathi Hrishikesh

IPC: H04L9/40 ,  G06F9/455 ,  H04L67/1097

CPC classification number: H04L63/0428 ,  G06F9/45558 ,  H04L63/062 ,  H04L67/1097

Abstract: Encryption of data occurs before it is written to the storage platform; decryption occurs after it is read from the storage platform on a computer separate from the storage platform. By encrypting data before it travels over a wide-area network to a storage platform (and by only decrypting that data once it has arrived at an enterprise from the storage platform), we address data security over the network. Application data is encrypted at the virtual disk level before it leaves a controller virtual machine, and is only decrypted at that controller virtual machine after being received from the storage platform. Encryption and decryption of data is compatible with other services of the storage system such as de-duplication. Any number of key management services can be used in a transparent manner.

公开(公告)号：US11789830B2

公开(公告)日：2023-10-17

申请号：US17465722

申请日：2021-09-02

Applicant: Commvault Systems, Inc.

Inventor： Deepak Jain ,  Lásaro Camargos ,  Srinivas Lakshman ,  Avinash Lakshman

IPC: G06F11/20 ,  G06F11/14

CPC classification number: G06F11/2058 ,  G06F11/1435 ,  G06F11/1464 ,  G06F11/1469 ,  G06F11/2082

Abstract: A strongly consistent distributed data storage system comprises an enhanced metadata service that is capable of fully recovering all metadata that goes missing when a metadata-carrying disk, disks, and/or partition fail. An illustrative recovery service runs automatically or on demand to bring the metadata node back into full service. Advantages of the recovery service include guaranteed full recovery of all missing metadata, including metadata still residing in commit logs, without impacting strong consistency guarantees of the metadata. The recovery service is network-traffic efficient. In preferred embodiments, the recovery service avoids metadata service downtime at the metadata node, thereby reducing the impact of metadata disk failure on the availability of the system. The disclosed metadata recovery techniques are said to be “self-healing” as they do not need manual intervention and instead automatically detect failures and automatically recover from the failures in a non-disruptive manner.

公开(公告)号：US11693572B2

公开(公告)日：2023-07-04

申请号：US17710600

申请日：2022-03-31

Applicant: Commvault Systems, Inc.

Inventor： Bharat Pundalik Naik ,  Xiangyu Wang ,  Avinash Lakshman

IPC: G06F3/06 ,  H04L67/1097

CPC classification number: G06F3/0641 ,  G06F3/067 ,  G06F3/0608 ,  G06F3/0619 ,  G06F3/0664 ,  G06F3/0665 ,  G06F3/0683 ,  H04L67/1097

Abstract: Disclosed deduplication techniques at a distributed data storage system guarantee that space reclamation will not affect deduplicated data integrity even without perfect synchronization between components. By understanding certain “behavioral” characteristics and schedule cadences of backup operations that generate backup copies received at the distributed data storage system, data blocks that are not re-written by subsequent backup copies are pro-actively aged, while promoting continued retention of data blocks that are re-written. An expiry scheme operates with block-level granularity. Each unique deduplicated data block is given an expiry timeframe based on the block's arrival time at the distributed data storage system (i.e., when a backup copy supplies the block) and further based on backup frequencies of the various virtual disks referencing a unique system-wide identifier of the block, which is based on the block's hash value. Communications between components are kept to an as-needed basis. Cloud-based and multi-cloud configurations are disclosed.