公开(公告)号：US20220100710A1

公开(公告)日：2022-03-31

申请号：US17465691

申请日：2021-09-02

Applicant: Commvault Systems, Inc.

Inventor： Lásaro CAMARGOS ,  Deepak JAIN ,  Avinash LAKSHMAN ,  Bharat Pundalik NAIK

IPC: G06F16/182 ,  G06F16/23

Abstract: In a running distributed data storage system that actively processes I/Os, metadata nodes are commissioned and decommissioned without taking down the storage system and without introducing interruptions to metadata or payload data I/O. The inflow of reads and writes continues without interruption even while new metadata nodes are in the process of being added and/or removed and the strong consistency of the system is guaranteed. Commissioning and decommissioning nodes within the running system enables streamlined replacement of permanently failed nodes and advantageously enables the system to adapt elastically to workload changes. An illustrative distributed barrier logic (the “view change barrier”) controls a multi-state process that controls a coordinated step-wise progression of the metadata nodes from an old view to a new normal. Rules for I/O handling govern each state until the state machine loop has been traversed and the system reaches its new normal.

公开(公告)号：US20220214997A1

公开(公告)日：2022-07-07

申请号：US17702644

申请日：2022-03-23

Applicant: Commvault Systems, Inc.

Inventor： Srividhya KAVAIPATTI ANANTHARAMAKRISHNAN ,  Lásaro CAMARGOS ,  Abhijith SHENOY ,  Xiangyu WANG ,  Avinash LAKSHMAN ,  Srinivas LAKSHMAN

IPC: G06F16/11 ,  G06F16/182

Abstract: A distributed data storage system comprises features for integration with application orchestrators such as Kubernetes, and includes a proprietary Container Storage Interface (CSI) driver. Features include setting snapshot scheduling and retention policies, and a “container data mover” that replicates data from a source to a distinct destination distributed data storage system. The migration may be configured one-to-one, one-to-many, unidirectional, and/or bi-directional. Metadata-based snapshots and metadata-based changed block tracking identify payload data to move from source to destination within application orchestrator frameworks at both ends. Payload data is migrated from source to destination using different techniques than those used for migrating metadata, e.g., kernel-to-kernel for copying payload data versus ordinary metadata writes. An illustrative barrier logic ensures that the migration follows a controlled progression of operations.

公开(公告)号：US20220092024A1

公开(公告)日：2022-03-24

申请号：US17179160

申请日：2021-02-18

Applicant: Commvault Systems, Inc.

Inventor： Srividhya KAVAIPATTI ANANTHARAMAKRISHNAN ,  Lásaro CAMARGOS ,  Abhijith SHENOY ,  Xiangyu WANG ,  Avinash LAKSHMAN ,  Srinivas LAKSHMAN

IPC: G06F16/11 ,  G06F16/182

Abstract: A distributed data storage system comprises features for integration with application orchestrators such as Kubernetes, and includes a proprietary Container Storage Interface (CSI) driver. Features include setting snapshot scheduling and retention policies, and a “container data mover” that replicates data from a source to a distinct destination distributed data storage system. The migration may be configured one-to-one, one-to-many, unidirectional, and/or bi-directional. Metadata-based snapshots and metadata-based changed block tracking identify payload data to move from source to destination within application orchestrator frameworks at both ends. Payload data is migrated from source to destination using different techniques than those used for migrating metadata, e.g., kernel-to-kernel for copying payload data versus ordinary metadata writes. An illustrative barrier logic ensures that the migration follows a controlled progression of operations.

公开(公告)号：US20230418716A1

公开(公告)日：2023-12-28

申请号：US18458377

申请日：2023-08-30

Applicant: Commvault Systems, Inc.

Inventor： Deepak JAIN ,  Lásaro CAMARGOS ,  Srinivas LAKSHMAN ,  Avinash LAKSHMAN

IPC: G06F11/20 ,  G06F11/14

CPC classification number: G06F11/2058 ,  G06F11/1435 ,  G06F11/2082 ,  G06F11/1469 ,  G06F11/1464

Abstract: A strongly consistent distributed data storage system comprises an enhanced metadata service that is capable of fully recovering all metadata that goes missing when a metadata-carrying disk, disks, and/or partition fail. An illustrative recovery service runs automatically or on demand to bring the metadata node back into full service. Advantages of the recovery service include guaranteed full recovery of all missing metadata, including metadata still residing in commit logs, without impacting strong consistency guarantees of the metadata. The recovery service is network-traffic efficient. In preferred embodiments, the recovery service avoids metadata service downtime at the metadata node, thereby reducing the impact of metadata disk failure on the availability of the system. The disclosed metadata recovery techniques are said to be “self-healing” as they do not need manual intervention and instead automatically detect failures and automatically recover from the failures in a non-disruptive manner.

公开(公告)号：US20220103622A1

公开(公告)日：2022-03-31

申请号：US17465683

申请日：2021-09-02

Applicant: Commvault Systems, Inc.

Inventor： Lásaro CAMARGOS ,  Deepak JAIN ,  Avinash LAKSHMAN ,  Bharat Pundalik NAIK

IPC: H04L67/1042 ,  G06F11/14 ,  G06F9/455

Abstract: In a running distributed data storage system that actively processes I/Os, metadata nodes are commissioned and decommissioned without taking down the storage system and without introducing interruptions to metadata or payload data I/O. The inflow of reads and writes continues without interruption even while new metadata nodes are in the process of being added and/or removed and the strong consistency of the system is guaranteed. Commissioning and decommissioning nodes within the running system enables streamlined replacement of permanently failed nodes and advantageously enables the system to adapt elastically to workload changes. An illustrative distributed barrier logic (the “view change barrier”) controls a multi-state process that controls a coordinated step-wise progression of the metadata nodes from an old view to a new normal. Rules for I/O handling govern each state until the state machine loop has been traversed and the system reaches its new normal.

公开(公告)号：US20220100618A1

公开(公告)日：2022-03-31

申请号：US17465722

申请日：2021-09-02

Applicant: Commvault Systems, Inc.

Inventor： Deepak JAIN ,  Lásaro CAMARGOS ,  Srinivas LAKSHMAN ,  Avinash LAKSHMAN

IPC: G06F11/20 ,  G06F11/10

Abstract: A strongly consistent distributed data storage system comprises an enhanced metadata service that is capable of fully recovering all metadata that goes missing when a metadata-carrying disk, disks, and/or partition fail. An illustrative recovery service runs automatically or on demand to bring the metadata node back into full service. Advantages of the recovery service include guaranteed full recovery of all missing metadata, including metadata still residing in commit logs, without impacting strong consistency guarantees of the metadata. The recovery service is network-traffic efficient. In preferred embodiments, the recovery service avoids metadata service downtime at the metadata node, thereby reducing the impact of metadata disk failure on the availability of the system. The disclosed metadata recovery techniques are said to be “self-healing” as they do not need manual intervention and instead automatically detect failures and automatically recover from the failures in a non-disruptive manner.