Using Metadata Servers in a Distributed Storage System

    公开(公告)号:US20250094094A1

    公开(公告)日:2025-03-20

    申请号:US18970070

    申请日:2024-12-05

    Abstract: A method for a storage network begins by receiving, from a requestor, an access request for metadata associated with a data object, where the data object is dispersed error encoded in accordance with dispersed storage error encoding parameters to produce a set of encoded data slices and distributedly stored among a plurality of storage units, where a decode threshold number of encoded data slices are needed to recover the data object. The method continues, by generating a metadata lookup for the data object and then receiving metadata from one or more storage units associated with the storage network. The method then continues, by mapping, based on the metadata, a file path and a storage location for accessing each encoded data slice of the set of encoded data slices. Finally, the method continues by providing, to the requestor, the file path and a storage location for accessing each encoded data slice of the set of encoded data slices and facilitating retrieval of the set of encoded data slices by the requestor.

    Managing Version Conflict in a Distributed Storage Network

    公开(公告)号:US20250039265A1

    公开(公告)日:2025-01-30

    申请号:US18913100

    申请日:2024-10-11

    Inventor: Greg Dhuse

    Abstract: A method for a computing device begins by generating a set of write requests regarding a set of encoded data slices and sending the set of write requests to a set of storage units, where each write request includes an encoded data slice of the set of encoded data slices and a version attribute, where a data object is dispersed error encoded in accordance with dispersed error encoding parameters to produce the set of encoded data slices. The method continues with the computing device receiving a write response indicating a version number conflict and in response to the version number conflict, retrieving a latest version of the data object, generating an updated set of write requests and sending the updated set of write requests to a set of storage units.

    Combining data objects in a vast data storage network

    公开(公告)号:US11093330B1

    公开(公告)日:2021-08-17

    申请号:US17195150

    申请日:2021-03-08

    Abstract: A method includes identifying an independent data object of a plurality of independent data objects for retrieval from dispersed storage network (DSN) memory. The method further includes determining a mapping of the plurality of independent data objects into a data matrix, wherein the mapping is in accordance with the dispersed storage error encoding function. The method further includes identifying, based on the mapping, an encoded data slice of the set of encoded data slices corresponding to the independent data object. The method further includes sending a retrieval request to a storage unit of the DSN memory regarding the encoded data slice. When the encoded data slice is received, the method further includes decoding the encoding data slice in accordance with the dispersed storage error encoding function and the mapping to reproduce the independent data object.

    Dynamically adjusting write requests for a multiple phase write operation

    公开(公告)号:US11036584B1

    公开(公告)日:2021-06-15

    申请号:US16526723

    申请日:2019-07-30

    Abstract: A method includes, for a current phase of a multiple phase write operation to write a set of encoded data slices to a set of storage units, determining whether to send a write performance threshold number of write requests to a subset of the set of storage units regarding a write performance threshold number of encoded data slices of the set of encoded data slices, where the set of encoded data slices includes a total number of encoded data slices, and wherein the write performance threshold number is less than the total number and greater than or equal to the write threshold number. When the write performance threshold number of write requests is to be sent to the subset of the set of storage units, the method continues by sending the write performance threshold number of write requests to the subset of the set of storage units.

    Concatenating data objects in a vast data storage network

    公开(公告)号:US10977127B1

    公开(公告)日:2021-04-13

    申请号:US17081056

    申请日:2020-10-27

    Abstract: A method includes identifying an independent data object of a plurality of independent data objects for retrieval from dispersed storage network (DSN) memory. The method further includes determining a mapping of the plurality of independent data objects into a data matrix, wherein the mapping is in accordance with the dispersed storage error encoding function. The method further includes identifying, based on the mapping, an encoded data slice of the set of encoded data slices corresponding to the independent data object. The method further includes sending a retrieval request to a storage unit of the DSN memory regarding the encoded data slice. When the encoded data slice is received, the method further includes decoding the encoding data slice in accordance with the dispersed storage error encoding function and the mapping to reproduce the independent data object.

    Concatenating data objects for storage in a vast data storage network

    公开(公告)号:US10853172B1

    公开(公告)日:2020-12-01

    申请号:US16988247

    申请日:2020-08-07

    Abstract: A method includes identifying an independent data object of a plurality of independent data objects for retrieval from dispersed storage network (DSN) memory. The method further includes determining a mapping of the plurality of independent data objects into a data matrix, wherein the mapping is in accordance with the dispersed storage error encoding function. The method further includes identifying, based on the mapping, an encoded data slice of the set of encoded data slices corresponding to the independent data object. The method further includes sending a retrieval request to a storage unit of the DSN memory regarding the encoded data slice. When the encoded data slice is received, the method further includes decoding the encoding data slice in accordance with the dispersed storage error encoding function and the mapping to reproduce the independent data object.

    Integrity Processing in a Dispersed Storage Network

    公开(公告)号:US20220091939A1

    公开(公告)日:2022-03-24

    申请号:US17457794

    申请日:2021-12-06

    Abstract: A distributed storage integrity system in a dispersed storage network includes a scanning agent and a control unit. The scanning agent identifies an encoded data slice that requires rebuilding, wherein the encoded data slice is one of a plurality of encoded data slices generated from a data segment using an error encoding dispersal function. The control unit retrieves at least a number T of encoded data slices needed to reconstruct the data segment based on the error encoding dispersal function. The control unit is operable to reconstruct the data segment from at least the number T of the encoded data slices and generate a rebuilt encoded data slice from the reconstructed data segment. The scanning agent is located in a storage unit and the control unit is located in the storage unit or in a storage integrity processing unit, a dispersed storage processing unit or a dispersed storage managing unit.

Patent Agency Ranking