公开(公告)号：US20240289300A1

公开(公告)日：2024-08-29

申请号：US18655558

申请日：2024-05-06

Applicant: Commvault Systems, Inc.

Inventor： Srividhya KAVAIPATTI ANANTHARAMAKRISHNAN ,  Lasaro CAMARGOS ,  Abhijith SHENOY ,  Xiangyu WANG ,  Avinash LAKSHMAN ,  Srinivas LAKSHMAN

IPC: G06F16/11 ,  G06F16/182

CPC classification number: G06F16/119 ,  G06F16/125 ,  G06F16/128 ,  G06F16/182

Abstract: A distributed data storage system comprises features for integration with application orchestrators such as Kubernetes, and includes a proprietary Container Storage Interface (CSI) driver. Features include setting snapshot scheduling and retention policies, and a “container data mover” that replicates data from a source to a distinct destination distributed data storage system. The migration may be configured one-to-one, one-to-many, unidirectional, and/or bi-directional. Metadata-based snapshots and metadata-based changed block tracking identify payload data to move from source to destination within application orchestrator frameworks at both ends. Payload data is migrated from source to destination using different techniques than those used for migrating metadata, e.g., kernel-to-kernel for copying payload data versus ordinary metadata writes. An illustrative barrier logic ensures that the migration follows a controlled progression of operations.

公开(公告)号：US20220019355A1

公开(公告)日：2022-01-20

申请号：US17336081

申请日：2021-06-01

Applicant: Commvault Systems, Inc.

Inventor： Suhani GUPTA ,  Avinash LAKSHMAN ,  Anand Vishwanath VASTRAD ,  Srinivas LAKSHMAN

IPC: G06F3/06

Abstract: A distributed data storage system using erasure coding (EC) provides advantages of EC data storage while retaining high resiliency for EC data storage architectures having fewer data storage nodes than the number of EC data-plus-parity fragments. To ameliorate the effects of certain storage node outages or fatal disk failures, incoming data is temporarily replicated so that read and write operations can continue from/to the storage system. The system automatically heals failed EC write attempts in a manner transparent to users and/or applications: when all storage nodes are operational, the distributed data storage system automatically converts the temporarily replicated data to EC storage and reclaims storage space previously used by the temporarily replicated data. Individual hardware failures are healed through migration techniques that reconstruct and re-fragment data blocks according to the governing EC scheme. An illustrative embodiment is a three-node data storage system using EC 4+2.

公开(公告)号：US20240338147A1

公开(公告)日：2024-10-10

申请号：US18745077

申请日：2024-06-17

Applicant: Commvault Systems, Inc.

Inventor： Avinash LAKSHMAN ,  Anand Vishwanath VASTRAD ,  Srinivas LAKSHMAN ,  Suhani GUPTA

IPC: G06F3/06

CPC classification number: G06F3/0655 ,  G06F3/0604 ,  G06F3/0619 ,  G06F3/064 ,  G06F3/065 ,  G06F3/0652 ,  G06F3/0664 ,  G06F3/067

Abstract: A distributed data storage system using erasure coding (EC) provides advantages of EC data storage while retaining high resiliency for EC data storage architectures having fewer data storage nodes than the number of EC data-plus-parity fragments. An illustrative embodiment is a three-node data storage system with EC 4+2. Incoming data is temporarily replicated to ameliorate the effects of certain storage node outages or fatal disk failures, so that read and write operations can continue from/to the storage system. The system is equipped to automatically heal failed EC write attempts in a manner transparent to users and/or applications: when all storage nodes are operational, the distributed data storage system automatically converts the temporarily replicated data to EC storage and reclaims storage space previously used by the temporarily replicated data. Individual hardware failures are healed through migration techniques that reconstruct and re-fragment data blocks according to the governing EC scheme.

公开(公告)号：US20220019372A1

公开(公告)日：2022-01-20

申请号：US17336103

申请日：2021-06-01

Applicant: Commvault Systems, Inc.

Inventor： Anand Vishwanath VASTRAD ,  Avinash LAKSHMAN ,  Suhani GUPTA ,  Srinivas LAKSHMAN

IPC: G06F3/06

Abstract: A distributed data storage system using erasure coding (EC) provides advantages of EC data storage while retaining high resiliency for EC data storage architectures having fewer data storage nodes than the number of EC data-plus-parity fragments. An illustrative embodiment is a three-node data storage system with EC 4+2. Incoming data is temporarily replicated to ameliorate the effects of certain storage node outages or fatal disk failures, so that read and write operations can continue from/to the storage system. The system is equipped to automatically heal failed EC write attempts in a manner transparent to users and/or applications: when all storage nodes are operational, the distributed data storage system automatically converts the temporarily replicated data to EC storage and reclaims storage space previously used by the temporarily replicated data. Individual hardware failures are healed through migration techniques that reconstruct and re-fragment data blocks according to the governing EC scheme.

公开(公告)号：US20230418716A1

公开(公告)日：2023-12-28

申请号：US18458377

申请日：2023-08-30

Applicant: Commvault Systems, Inc.

Inventor： Deepak JAIN ,  Lásaro CAMARGOS ,  Srinivas LAKSHMAN ,  Avinash LAKSHMAN

IPC: G06F11/20 ,  G06F11/14

CPC classification number: G06F11/2058 ,  G06F11/1435 ,  G06F11/2082 ,  G06F11/1469 ,  G06F11/1464

Abstract: A strongly consistent distributed data storage system comprises an enhanced metadata service that is capable of fully recovering all metadata that goes missing when a metadata-carrying disk, disks, and/or partition fail. An illustrative recovery service runs automatically or on demand to bring the metadata node back into full service. Advantages of the recovery service include guaranteed full recovery of all missing metadata, including metadata still residing in commit logs, without impacting strong consistency guarantees of the metadata. The recovery service is network-traffic efficient. In preferred embodiments, the recovery service avoids metadata service downtime at the metadata node, thereby reducing the impact of metadata disk failure on the availability of the system. The disclosed metadata recovery techniques are said to be “self-healing” as they do not need manual intervention and instead automatically detect failures and automatically recover from the failures in a non-disruptive manner.

公开(公告)号：US20220100618A1

公开(公告)日：2022-03-31

申请号：US17465722

申请日：2021-09-02

Applicant: Commvault Systems, Inc.

Inventor： Deepak JAIN ,  Lásaro CAMARGOS ,  Srinivas LAKSHMAN ,  Avinash LAKSHMAN

IPC: G06F11/20 ,  G06F11/10

Abstract: A strongly consistent distributed data storage system comprises an enhanced metadata service that is capable of fully recovering all metadata that goes missing when a metadata-carrying disk, disks, and/or partition fail. An illustrative recovery service runs automatically or on demand to bring the metadata node back into full service. Advantages of the recovery service include guaranteed full recovery of all missing metadata, including metadata still residing in commit logs, without impacting strong consistency guarantees of the metadata. The recovery service is network-traffic efficient. In preferred embodiments, the recovery service avoids metadata service downtime at the metadata node, thereby reducing the impact of metadata disk failure on the availability of the system. The disclosed metadata recovery techniques are said to be “self-healing” as they do not need manual intervention and instead automatically detect failures and automatically recover from the failures in a non-disruptive manner.

公开(公告)号：US20220214997A1

公开(公告)日：2022-07-07

申请号：US17702644

申请日：2022-03-23

Applicant: Commvault Systems, Inc.

Inventor： Srividhya KAVAIPATTI ANANTHARAMAKRISHNAN ,  Lásaro CAMARGOS ,  Abhijith SHENOY ,  Xiangyu WANG ,  Avinash LAKSHMAN ,  Srinivas LAKSHMAN

IPC: G06F16/11 ,  G06F16/182

Abstract: A distributed data storage system comprises features for integration with application orchestrators such as Kubernetes, and includes a proprietary Container Storage Interface (CSI) driver. Features include setting snapshot scheduling and retention policies, and a “container data mover” that replicates data from a source to a distinct destination distributed data storage system. The migration may be configured one-to-one, one-to-many, unidirectional, and/or bi-directional. Metadata-based snapshots and metadata-based changed block tracking identify payload data to move from source to destination within application orchestrator frameworks at both ends. Payload data is migrated from source to destination using different techniques than those used for migrating metadata, e.g., kernel-to-kernel for copying payload data versus ordinary metadata writes. An illustrative barrier logic ensures that the migration follows a controlled progression of operations.

公开(公告)号：US20220092024A1

公开(公告)日：2022-03-24

申请号：US17179160

申请日：2021-02-18

Applicant: Commvault Systems, Inc.

Inventor： Srividhya KAVAIPATTI ANANTHARAMAKRISHNAN ,  Lásaro CAMARGOS ,  Abhijith SHENOY ,  Xiangyu WANG ,  Avinash LAKSHMAN ,  Srinivas LAKSHMAN

IPC: G06F16/11 ,  G06F16/182

Abstract: A distributed data storage system comprises features for integration with application orchestrators such as Kubernetes, and includes a proprietary Container Storage Interface (CSI) driver. Features include setting snapshot scheduling and retention policies, and a “container data mover” that replicates data from a source to a distinct destination distributed data storage system. The migration may be configured one-to-one, one-to-many, unidirectional, and/or bi-directional. Metadata-based snapshots and metadata-based changed block tracking identify payload data to move from source to destination within application orchestrator frameworks at both ends. Payload data is migrated from source to destination using different techniques than those used for migrating metadata, e.g., kernel-to-kernel for copying payload data versus ordinary metadata writes. An illustrative barrier logic ensures that the migration follows a controlled progression of operations.