Enabling data integrity checking and faster application recovery in synchronous replicated datasets

    公开(公告)号:US11199979B2

    公开(公告)日:2021-12-14

    申请号:US16730832

    申请日:2019-12-30

    Applicant: NetApp Inc.

    Abstract: One or more techniques and/or computing devices are provided for utilizing snapshots for data integrity validation and/or faster application recovery. For example, a first storage controller, hosting first storage, has a synchronous replication relationship with a second storage controller hosting second storage. A snapshot replication policy rule is defined to specify that a replication label is to be used for snapshot create requests, targeting the first storage, that are to be replicated to the second storage. A snapshot creation policy is created to issue snapshot create requests comprising the replication label. Thus a snapshot of the first storage and a replication snapshot of the second storage are created based upon a snapshot create request comprising the replication label. The snapshot and the replication snapshot may be compared for data integrity validation (e.g., determine whether the snapshots comprise the same data) and/or quickly recovering an application after a disaster.

    DYNAMIC RECYCLING ALGORITHM TO HANDLE OVERLAPPING WRITES DURING SYNCHRONOUS REPLICATION OF APPLICATION WORKLOADS WITH LARGE NUMBER OF FILES

    公开(公告)号:US20210303165A1

    公开(公告)日:2021-09-30

    申请号:US17344805

    申请日:2021-06-10

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for overlapping write handling. Overlapping write managers are used to maintain the order that write operations are executed at a first computing environment and replicated to a second computing environment. Overlapping write managers are pre-allocated as available for managing overlapping write operations. A mapping is used to track what overlapping write managers are currently allocated for particular file handles of files. Thus, if an incoming write operation targets a file handle of an already allocated overlapping write manager, then that overlapping write manager is used to execute and replicate the incoming write operation so that the order of execution of overlapping writes by the second computing environment is the same as at the first computing environment. If there is no allocated overlapping write manager for the file handle, then a new overlapping write manager is allocated and utilized.

    FILE SYSTEM OPERATION HANDLING DURING CUTOVER AND STEADY STATE

    公开(公告)号:US20210224293A1

    公开(公告)日:2021-07-22

    申请号:US17221043

    申请日:2021-04-02

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for synchronous replication based cutover. An asynchronous replication process is executed to perform asynchronous incremental transfers of data of a storage object from a first computing environment to a replicated storage object at a second computing environment until a cutover criteria is met. A synchronous replication process is executed to synchronously replicate operations, targeting the storage object, to the replicated storage object based upon the cutover criteria being met. A cutover is performed to direct operations from targeting the storage object to targeting the replicated storage object based upon the synchronous replication process reaching a steady state of synchronous replication for sub-objects of the storage object, where operations are committed to both the storage object and the replicated storage object.

    File system operation handling during cutover and steady state

    公开(公告)号:US11068503B2

    公开(公告)日:2021-07-20

    申请号:US16401224

    申请日:2019-05-02

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for synchronous replication based cutover. An asynchronous replication process is executed to perform asynchronous incremental transfers of data of a storage object from a first computing environment to a replicated storage object at a second computing environment until a cutover criteria is met. A synchronous replication process is executed to synchronously replicate operations, targeting the storage object, to the replicated storage object based upon the cutover criteria being met. A cutover is performed to direct operations from targeting the storage object to targeting the replicated storage object based upon the synchronous replication process reaching a steady state of synchronous replication for sub-objects of the storage object, where operations are committed to both the storage object and the replicated storage object.

    Synchronous replication based cutover engine

    公开(公告)号:US10970310B2

    公开(公告)日:2021-04-06

    申请号:US16191582

    申请日:2018-11-15

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for synchronous replication based cutover. An asynchronous replication process is executed to perform asynchronous incremental transfers of data of a storage object from a first computing environment to a replicated storage object at a second computing environment until a cutover criteria is met. A synchronous replication process is executed to synchronously replicate operations, targeting the storage object, to the replicated storage object based upon the cutover criteria being met. A cutover is performed to direct operations from targeting the storage object to targeting the replicated storage object based upon the synchronous replication process reaching a steady state of synchronous replication for sub-objects of the storage object, where operations are committed to both the storage object and the replicated storage object.

    SNAPSHOT METADATA ARRANGEMENT FOR EFFICIENT CLOUD INTEGRATED DATA MANAGEMENT

    公开(公告)号:US20210004353A1

    公开(公告)日:2021-01-07

    申请号:US17029920

    申请日:2020-09-23

    Applicant: NetApp, Inc.

    Abstract: A storage appliance arranges snapshot data and snapshot metadata into different structures, and arranges the snapshot metadata to facilitate efficient snapshot manipulation, which may be for snapshot management or snapshot restore. The storage appliance receives snapshots according to a forever incremental configuration and arranges snapshot metadata into different types of records. The storage appliance stores these records in key-value stores maintained for each defined data collection (e.g., volume). The storage appliance arranges the snapshot metadata into records for inode information, records for directory information, and records that map source descriptors of data blocks to snapshot file descriptors. The storage appliance uses a locally generated snapshot identifier as a key prefix for the records to conform to a sort constrain of the key-value store, which allows the efficiency of the key-value store to be leveraged. The snapshot metadata arrangement facilitates efficient snapshot restore, file restore, and snapshot reclamation.

    NON-DISRUPTIVE TRANSITION TO SYNCHRONOUS REPLICATION STATE

    公开(公告)号:US20200285655A1

    公开(公告)日:2020-09-10

    申请号:US16293807

    申请日:2019-03-06

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for transitioning a first storage object and a second storage object from an asynchronous replication state to a synchronous replication state. Metadata operations are logged into a metadata log. Dirty data, modified by data operations executed upon the first storage object, are tracked using a dirty region log. Metadata operations are replicated from the metadata log to the second storage object during a metadata drain phase. During the metadata drain phase, incoming operations are logged into the metadata log when the metadata log has a non-zero size, otherwise, the metadata operations are replicated to the second storage object. After the metadata drain phase, a data drain phase is performed using the dirty region log.

    Dynamic recycling algorithm to handle overlapping writes during synchronous replication of application workloads with large number of files

    公开(公告)号:US10725691B1

    公开(公告)日:2020-07-28

    申请号:US16288437

    申请日:2019-02-28

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for overlapping write handling. Overlapping write managers are used to maintain the order that write operations are executed at a first computing environment and replicated to a second computing environment. Overlapping write managers are pre-allocated as available for managing overlapping write operations. A mapping is used to track what overlapping write managers are currently allocated for particular file handles of files. Thus, if an incoming write operation targets a file handle of an already allocated overlapping write manager, then that overlapping write manager is used to execute and replicate the incoming write operation so that the order of execution of overlapping writes by the second computing environment is the same as at the first computing environment. If there is no allocated overlapping write manager for the file handle, then a new overlapping write manager is allocated and utilized.

    SYNCHRONOUS REPLICATION
    120.
    发明申请

    公开(公告)号:US20200081625A1

    公开(公告)日:2020-03-12

    申请号:US16683427

    申请日:2019-11-14

    Applicant: NetApp Inc.

    Abstract: One or more techniques and/or computing devices are provided for synchronous replication. For example, synchronous replication relationships are established between a first storage object (e.g., a file, a logical unit number (LUN), a consistency group, etc.), hosted by a first storage controller, and a plurality of replication storage objects hosted by other storage controllers. In this way, a write operation to the first storage object is implemented in parallel upon the first storage object and the replication storage objects in a synchronous manner, such as using a zero-copy operation to reduce overhead otherwise introduced by performing copy operations. Reconciliation is performed in response to a failure so that the first storage object and the replication storage objects comprise consistent data. Failed write operations and replication write operations are retried, while enforcing a single write semantic. Dependent write order consistency is enforced for dependent write operations, such as overlapping write operations.

Patent Agency Ranking