Partial Task Processing with Data Slice Errors

    公开(公告)号:US20230067246A1

    公开(公告)日:2023-03-02

    申请号:US18046182

    申请日:2022-10-13

    Abstract: A storage network receives data and a corresponding task, selects a storage units for the task, determines whether the data slice is locally available and when the data slice is not locally available, determines whether a redundant data slice is available from another storage unit. When the redundant data slice is not available from another storage unit, the storage network facilitates rebuilding the data slice to produce a rebuilt data slice by retrieving a decode threshold number of data slices corresponding to the data slice, decoding the decode threshold number of data slices to reproduce a data segment and re-encoding the data segment to produce a pillar width number of data slices that includes the rebuilt data slice. The storage network then stores locally either the rebuilt data slice or the redundant data slice and processes one of: the data slice locally available, the rebuilt data slice stored locally, or the redundant data slice stored locally in accordance with the corresponding partial task to produce a partial result.

    Adjusting efficiency of storing data in a storage network

    公开(公告)号:US11586755B1

    公开(公告)日:2023-02-21

    申请号:US17247417

    申请日:2020-12-10

    Abstract: A method for execution by a computing device to adjust data storage efficiency of data in a storage network includes determining an estimated overwrite frequency for a data segment for storage in memory of the storage network. The method continues by determining a storage approach for the data segment based on the estimated overwrite frequency. The method continues by processing the data segment based on the storage approach to produce a processed data segment. The method continues by error encoding the processed data segment to produce a set of encoded data slices, where a decode threshold number of encoded data slices is needed to recover the processed data segment. The method continues by storing the set of encoded data slices in the memory of the storage network.

    Proxying a Data Access Request in a Storage Network

    公开(公告)号:US20220360541A1

    公开(公告)日:2022-11-10

    申请号:US17814022

    申请日:2022-07-21

    Abstract: Methods and apparatus for proxying data access requests in a storage network are disclosed. In various embodiments, a computing device associated with a first storage location of the storage network performs a method that includes receiving a portion of data that is in the process of being replicated from a second storage location of the storage network. The computing device facilitates storage of the portion of data in the first storage location of the storage network. In response to receiving a read request for the portion of data during the data replication process, the computing device determines whether the portion of data is available from memory of the first storage location. In response to determining that the portion of data is available from memory of the first storage location, the computing device issues a read response that includes the portion of data.

    Storage Network with Multiple Storage Types

    公开(公告)号:US20220342759A1

    公开(公告)日:2022-10-27

    申请号:US17811168

    申请日:2022-07-07

    Abstract: A processing system of a storage network operates by: receiving a write request to store a data object; selecting a selected memory type of a plurality of memory types to store the data object, based on object parameters associated with the data object; selecting a selected memory to store the data object, the selected memory having the selected memory type of the plurality of memory types; and facilitating storage of the data object in the selected memory having the selected memory type of the plurality of memory types, wherein the data object is dispersed error encoded and stored as a plurality of encoded data slices.

    Utilizing Locally Decodable Redundancy Data in a Vast Storage Network

    公开(公告)号:US20220327022A1

    公开(公告)日:2022-10-13

    申请号:US17850145

    申请日:2022-06-27

    Abstract: A network storage system operates by: sending, to at least one storage unit of a storage network, at least one read request corresponding to at least a read threshold number of a set of encoded data slices to be retrieved, wherein the set of encoded data slices correspond to a data segment, wherein the data segment is codable in accordance with dispersed error coding parameters that include a write threshold number and the read threshold number, wherein the write threshold number is a number of encoded data slices in the set of encoded data slices and wherein the read threshold number is a number of the set of slices that is required to decode the data segment; receiving from the at least one storage unit, a first subset of encoded data slices of the set of encoded data slices, wherein the first subset of encoded data slices is missing at least one missing encoded data slice from the number of the set of slices that is required to decode the data segment and that was not received from the at least one storage unit in response to the at least one read request; generating at least one rebuilt encoded data slice corresponding to the at least one missing encoded data slice utilizing locally decodable redundancy data, wherein the locally decodable redundancy data includes a plurality of local redundancy slices generated from a second subset of the set of encoded data slices that includes the at least one missing encoded data slice; and recovering the data segment based on the at least one rebuilt encoded data slice and the first subset of encoded data slices.

    Performance Aided Data Migration in a Distributed Storage Network

    公开(公告)号:US20220278821A1

    公开(公告)日:2022-09-01

    申请号:US17663566

    申请日:2022-05-16

    Abstract: A method begins by a processing module of a storage unit of a storage network identifying a first storage format used to store a plurality of encoded data slices in a first memory of the storage unit and continues with the processing module determining to utilize another storage format for storage of the plurality of encoded data slices. The method then continues, with the storage unit selecting a second storage format for storage of the plurality of encoded data slices and initiating migration of the plurality of encoded data slices from the first storage format to storage using the second storage format. Finally, the method continues with updating a performance metric for at least a portion of the storage network while initiating migrating the plurality of encoded data slices.

    Verifying system registry files in a storage network

    公开(公告)号:US11410019B1

    公开(公告)日:2022-08-09

    申请号:US16986599

    申请日:2020-08-06

    Abstract: A method for execution by a dispersed storage and task (DST) execution unit includes receiving system registry integrity data via a network that corresponds to a plurality of system registry files, a request for a subset of the plurality of system registry files is generated for transmission to a dispersed storage network (DSN) unit via the network. The subset of system registry files are received from the DSN unit via the network. Integrity check data is generated based on the received subset of the plurality of system registry files and the system registry integrity data, where the integrity check data includes a verification indicator. The system registry files are stored in memory when the verification indicator indicates that verification was successful.

    Generating Estimated Efficiency Models For Selecting A Processing Unit In A Storage Network

    公开(公告)号:US20220222142A1

    公开(公告)日:2022-07-14

    申请号:US17657545

    申请日:2022-03-31

    Abstract: A method for execution by a computing device of a storage network begins or continues by generating a plurality of estimated efficiency models associated with a plurality of processing units of the storage network, where an estimated efficiency model of the plurality of estimated efficiency models includes estimated efficiency probabilities, and where the estimated efficiency probabilities correspond to data access request types for a processing unit of the plurality of processing units. The method further includes storing the plurality of estimated efficiency models in memory of the storage network.

    Maintaining storage of encoded data slices

    公开(公告)号:US11385964B1

    公开(公告)日:2022-07-12

    申请号:US17067482

    申请日:2020-10-09

    Abstract: A method for execution by a computing device of a storage network includes determining an encoded data slice reduction scheme for a set of encoded data slices stored in a set of storage units of the storage network, where a data segment of data is encoded into the set of encoded data slices in accordance with encoding parameters, and where the encoding parameters include a pillar width number and a decode threshold number. The method further includes maintaining storage of the set of encoded data slices in accordance with the encoded data slice reduction scheme, where the maintaining storage includes keeping, until a deletion time for the set of encoded data slices, a number of encoded data slices of the set of encoded data slices equal to or greater than the decode threshold number and less than the pillar width number.

Patent Agency Ranking