PERSISTENT KEY-VALUE STORE AND JOURNALING SYSTEM

    公开(公告)号:US20240232080A1

    公开(公告)日:2024-07-11

    申请号:US18615014

    申请日:2024-03-25

    Applicant: NetApp, Inc.

    Abstract: Techniques are provided for implementing a persistent key-value store for caching client data, journaling, and/or crash recovery. The persistent key-value store may be hosted as a primary cache that provides read and write access to key-value record pairs stored within the persistent key-value store. The key-value record pairs are stored within multiple chains in the persistent key-value store. Journaling is provided for the persistent key-value store such that incoming key-value record pairs are stored within active chains, and data within frozen chains is written in a distributed manner across distributed storage of a distributed cluster of nodes. If there is a failure within the distributed cluster of nodes, then the persistent key-value store may be reconstructed and used for crash recovery.

    CO-LOCATED JOURNALING AND DATA STORAGE FOR WRITE REQUESTS

    公开(公告)号:US20220342577A1

    公开(公告)日:2022-10-27

    申请号:US17849290

    申请日:2022-06-24

    Applicant: NetApp, Inc.

    Abstract: A method and system for co-locating journaling and data storage based on write requests. A write request that includes metadata and data is received from a client. A logical storage unit for storing the metadata and the data is identified. The logical storage unit is divided into a journal partition and a volume partition. The journal partition includes a first log and a second log. Which of the first log and the second log is an active log and which of the first log and the second log is an inactive log are identified. The metadata is recorded in a first location in the active log and the data is recorded in a second location in the active log during a single I/O operation. A reply is sent to the client after the metadata and the data are recorded in the journal partition.

    Network storage failover systems and associated methods

    公开(公告)号:US11216350B2

    公开(公告)日:2022-01-04

    申请号:US16855853

    申请日:2020-04-22

    Applicant: NETAPP, INC.

    Abstract: Failover methods and systems for a networked storage environment are provided. A metadata data structure is generated, before starting a replay of entries at a log stored in a non-volatile memory of a second storage node, during a failover operation initiated in response to a failure at a first storage node. The second storage node operates as a partner node of the first storage node, and the metadata structure stores a metadata attribute of each log entry. Furthermore, the metadata attribute of each log entry is persistently stored. The persistently stored metadata attribute is used to respond to a read request received during the replay by the second storage node, while a write request metadata attribute of a write request is used for executing the write request received by the second storage node during the replay.

    Detecting data loss during site switchover
    16.
    发明授权
    Detecting data loss during site switchover 有权
    在站点切换期间检测数据丢失

    公开(公告)号:US09367413B2

    公开(公告)日:2016-06-14

    申请号:US14266733

    申请日:2014-04-30

    Applicant: NetApp, Inc.

    Abstract: Techniques for detecting data loss during site switchover are disclosed. An example method includes storing at NVRAM of a first node a plurality of operations of a second node, the first and second nodes being disaster recovery partners. The method also includes during a switchover from the second node to the first node, receiving an indication of a first number of operations yet to be completed. The method further includes comparing the first number to a second number of operations in the plurality of operations stored at the NVRAM of the first node. The method also includes in response to the comparing, determining whether at least one operation is missing from the plurality of operations stored in the NVRAM of the first node. The method further includes in response to determining that at least one operation is missing, failing at least one volume.

    Abstract translation: 公开了在现场切换期间检测数据丢失的技术。 一个示例性方法包括在NVRAM的第一节点处存储第二节点的多个操作,第一和第二节点是灾难恢复伙伴。 该方法还包括在从第二节点切换到第一节点期间,接收尚待完成的第一数量的操作的指示。 该方法还包括将第一数量与存储在第一节点的NVRAM中的多个操作中的第二数量的操作进行比较。 该方法还包括响应于比较,确定从存储在第一节点的NVRAM中的多个操作中是否丢失了至少一个操作。 该方法还包括响应于确定至少一个操作丢失,至少一个卷失败。

    PERSISTENT KEY-VALUE STORE AND JOURNALING SYSTEM

    公开(公告)号:US20230195622A1

    公开(公告)日:2023-06-22

    申请号:US17553930

    申请日:2021-12-17

    Applicant: NetApp Inc.

    Abstract: Techniques are provided for implementing a persistent key-value store for caching client data, journaling, and/or crash recovery. The persistent key-value store may be hosted as a primary cache that provides read and write access to key-value record pairs stored within the persistent key-value store. The key-value record pairs are stored within multiple chains in the persistent key-value store. Journaling is provided for the persistent key-value store such that incoming key-value record pairs are stored within active chains, and data within frozen chains is written in a distributed manner across distributed storage of a distributed cluster of nodes. If there is a failure within the distributed cluster of nodes, then the persistent key-value store may be reconstructed and used for crash recovery.

    Network storage failover systems and associated methods

    公开(公告)号:US11269744B2

    公开(公告)日:2022-03-08

    申请号:US16855837

    申请日:2020-04-22

    Applicant: NETAPP, INC.

    Abstract: Failover methods and systems for a networked storage environment are provided. A filtering data structure and a metadata data structure are generated before starting a replay of a log stored in a non-volatile memory of a second storage node, during a failover operation initiated in response to a failure at a first storage node. The second storage node operates as a partner node of the first storage node to mirror at the log one or more write requests received by the first storage node prior to the failure, and data associated with the one or more write requests. The filtering data structure identifies each log entry and the metadata structure stores a metadata attribute of each log entry. The filtering data structure and the metadata structure are used for providing access to a logical storage object during the log replay from the second storage node.

Patent Agency Ranking