公开(公告)号：US09176822B2

公开(公告)日：2015-11-03

申请号：US13944342

申请日：2013-07-17

Applicant: CLEVERSAFE, INC.

Inventor： Yogesh Ramesh Vedpathak ,  Ramin Rouzbeh ,  Jason K. Resch

IPC: G06F11/00 ,  G06F11/14 ,  G06F11/10 ,  H03M13/00 ,  G06F11/20 ,  H04L9/08 ,  G06F21/62

CPC classification number: G06F11/1076 ,  G06F11/0712 ,  G06F11/0784 ,  G06F11/0787 ,  G06F11/1004 ,  G06F11/1044 ,  G06F11/1092 ,  G06F11/142 ,  G06F11/2094 ,  G06F21/10 ,  G06F21/60 ,  G06F21/6272 ,  H03M13/611 ,  H03M13/616 ,  H04L9/0861 ,  H04L9/0894 ,  H04L67/1097 ,  H04L2209/34

Abstract: A method begins by a processing module receiving a large data file for storage in a dispersed storage network (DSN) and determining initial dispersed storage error encoding parameters. The method continues with the processing module encoding, during a first time interval of receiving the large data file, first data segments of the large data file using the initial dispersed storage error encoding parameters to produce a first plurality of sets of encoded data slices. The method continues with the processing module writing the first plurality of sets of encoded data slices to the DSN and monitoring processing of the writing to produce first write processing performance information. When the first write processing performance information compares unfavorably to a desired write performance range, the method continues with the processing module adjusting, for a second time interval, the initial dispersed storage error encoding parameters to produce adjusted dispersed storage error encoding parameters.

Abstract translation: 一种处理模块从处理模块开始接收用于存储在分散存储网络（DSN）中的大数据文件，并确定初始分散的存储错误编码参数。 该方法继续处理模块在接收大数据文件的第一时间间隔期间使用初始分散的存储错误编码参数来编码大数据文件的第一数据段，以产生第一组多组编码数据片。 该方法继续处理模块将第一组多组编码数据片写入DSN，并监视处理写入以产生第一写入处理性能信息。 当第一写入处理性能信息与期望的写入性能范围不利地进行比较时，该方法继续处理模块在第二时间间隔内调整初始分散存储错误编码参数以产生经调整的分散存储错误编码参数。

公开(公告)号：US09778987B2

公开(公告)日：2017-10-03

申请号：US14570366

申请日：2014-12-15

Applicant: CLEVERSAFE, INC.

Inventor： Thomas Franklin Shirley, Jr. ,  Gary W. Grube ,  Bart Cilfone ,  Ravi Khadiwala ,  Greg Dhuse ,  Thomas Darrel Cocagne ,  Michael Colin Storm ,  Yogesh Ramesh Vedpathak ,  Wesley Leggette ,  Jason K. Resch ,  Andrew Baptist ,  Ilya Volvovski

IPC: G06F12/10 ,  G06F11/10 ,  H04L29/08 ,  G06F21/62 ,  G06F3/06 ,  H04L29/06

CPC classification number: G06F11/1092 ,  G06F3/06 ,  G06F21/6218 ,  G06F2211/1028 ,  H04L63/20 ,  H04L67/1097

Abstract: A method for writing a set of encoded data slices to memory of a dispersed storage network (DSN) begins by a processing module identifying an encoded data slice of the set of encoded data slices for a redundant write operation to produce an identified encoded data slice. The method continues with the processing module generating a set of first write requests regarding the set of encoded data slices less the identified encoded data slice and generating a set of second write requests regarding the identified encoded data slice. The method continues with the processing module sending the set of first write requests to storage units of the DSN and sending the set of second write requests to a set of storage units of the DSN, where each storage unit of the set of storage units is sent a corresponding one of the set of second write requests.

公开(公告)号：US20150355960A1

公开(公告)日：2015-12-10

申请号：US14680459

申请日：2015-04-07

Applicant: CLEVERSAFE, INC.

Inventor： Ilya Volvovski ,  Bruno Hennig Cabral ,  Manish Motwani ,  Thomas Darrel Cocagne ,  Timothy W. Markison ,  Gary W. Grube ,  Wesley Leggette ,  Jason K. Resch ,  Michael Colin Storm ,  Greg Dhuse ,  Yogesh Ramesh Vedpathak ,  Ravi Khadiwala

IPC: G06F11/07

CPC classification number: G06F11/1076 ,  G06F3/0619 ,  G06F3/064 ,  G06F3/067 ,  G06F11/0709 ,  G06F11/0727 ,  G06F11/0775 ,  G06F2211/1004 ,  G06F2211/1028 ,  H04L67/1097

Abstract: When an access metric regarding an encoded data object exceeds an access threshold, a method begins by a processing module of a dispersed storage network (DSN) retrieving encoded data slices of a first plurality of sets of encoded data slices and recovering the data object utilizing first dispersed storage error encoding parameters. The method continues with the processing module re-encoding the recovered data object using second dispersed storage error encoding parameters to produce a re-encoded data object, where the re-encoded data object includes a second plurality of sets of encoded data slices. The method continues with the processing module outputting the second plurality of sets of encoded data slices to storage units of the DSN for storage therein and sending a message to retrieving devices of the DSN, where the message indicates use of the second plurality of sets of encoded data slices for the data object.

Abstract translation: 当关于编码数据对象的访问度量超过访问阈值时，方法由分散存储网络（DSN）的处理模块开始，检索第一多组编码数据片段的编码数据片段，并且利用第一数据对象来恢复数据对象 分散存储错误编码参数。 该方法继续处理模块使用第二分散存储错误编码参数对恢复的数据对象进行重新编码，以产生重新编码的数据对象，其中重新编码的数据对象包括第二组多组编码数据片段。 该方法继续处理模块将第二组编码数据片段输出到DSN的存储单元以存储在其中，并向DSN的检索设备发送消息，其中消息指示使用第二组编码的 数据对象的数据切片。

公开(公告)号：US10152601B2

公开(公告)日：2018-12-11

申请号：US14675360

申请日：2015-03-31

Applicant: CLEVERSAFE, INC.

Inventor： Ilya Volvovski ,  Bruno Hennig Cabral ,  Manish Motwani ,  Thomas Darrel Cocagne ,  Timothy W. Markison ,  Gary W. Grube ,  Wesley Leggette ,  Jason K. Resch ,  Michael Colin Storm ,  Greg Dhuse ,  Yogesh Ramesh Vedpathak ,  Ravi Khadiwala

IPC: G06F17/30 ,  G06F21/60 ,  G06F11/14 ,  H04L29/08 ,  G06F21/62 ,  H04L9/08 ,  H04L29/06

Abstract: A method begins by storage units of a dispersed storage network (DSN) receiving a retrieval request for a data object, where each storage unit stores a unique group of encoded data slices of the data object and a local set of encoded recovery data slices. The method continues with some storage units sending the unique group of encoded data slices to a requesting computing device and with one storage unit sending an encoded recovery data slice to the requesting computing device. The method continues with the requesting computing device identifying an errant unique group encoded data slice, correcting the errant encoded data slice based on received data slices to produce an updated unique group of encoded data slices, and dispersed storage error decoding the updated unique group of encoded data slices and the unique groups of encoded data slices from other storage units to recover the data object.

公开(公告)号：US10095872B2

公开(公告)日：2018-10-09

申请号：US14675183

申请日：2015-03-31

Applicant: CLEVERSAFE, INC.

Inventor： Ilya Volvovski ,  Bruno Hennig Cabral ,  Manish Motwani ,  Thomas Darrel Cocagne ,  Timothy W. Markison ,  Gary W. Grube ,  Wesley Leggette ,  Jason K. Resch ,  Michael Colin Storm ,  Greg Dhuse ,  Yogesh Ramesh Vedpathak ,  Ravi Khadiwala

IPC: G06F17/30 ,  G06F21/60 ,  G06F11/14 ,  H04L29/08 ,  G06F21/62 ,  H04L9/08 ,  H04L29/06

Abstract: A method begins by a set of storage units of a dispersed storage network (DSN) storing a plurality of encoded data slices, where each storage unit stores a unique sub-set of encoded data slices. The method continues with each storage unit dispersed storage error encoding at least a recovery threshold number of encoded data slices to produce a local set of encoded recovery data slices. In response to a retrieval request, the method continues with a device identifying a storage unit of an initial recovery number of storage units having a rebuilding issue and determining whether the rebuilding issue is correctable at a DSN level. When the rebuilding issue is correctable at the DSN level the method continues with the device selecting another storage unit to replace the storage unit to produce a recovery number of storage units and sending retrieve requests to the recovery number of storage units.

公开(公告)号：US09857974B2

公开(公告)日：2018-01-02

申请号：US14450804

申请日：2014-08-04

Applicant: CLEVERSAFE, INC.

Inventor： Andrew Baptist ,  Joseph Martin Kaczmarek ,  Yogesh Ramesh Vedpathak

IPC: G06F15/16 ,  G06F3/06 ,  H04L29/08 ,  G06F11/10 ,  G06F9/48 ,  G06F12/14 ,  G06F21/31 ,  G06F21/62 ,  G06F17/30

CPC classification number: G06F3/0604 ,  G06F3/0611 ,  G06F3/0647 ,  G06F3/0655 ,  G06F3/0665 ,  G06F3/067 ,  G06F3/0689 ,  G06F9/4881 ,  G06F11/1076 ,  G06F12/1458 ,  G06F17/30067 ,  G06F17/30194 ,  G06F21/31 ,  G06F21/6272 ,  G06F2003/0698 ,  G06F2211/1028 ,  G06F2212/1052 ,  G06F2212/154 ,  G06F2221/2149 ,  H04L67/1002 ,  H04L67/1095 ,  H04L67/1097 ,  H04L67/145

Abstract: A method includes a dispersed storage (DS) processing module receiving a request. The method continues by identifying a session associated with the request. The method continues by queueing one or more tasks associated with the request. The method continues by determining whether the session is still active. When the session is not active, the method continues by cancelling the one or more tasks associated with the session prior to execution. When the session is still active, the method continues by executing the first task of the one or more tasks when a task resource is available.

公开(公告)号：US09588686B2

公开(公告)日：2017-03-07

申请号：US14452475

申请日：2014-08-05

Applicant: CLEVERSAFE, INC.

Inventor： Andrew Baptist ,  Ilya Volvovski ,  Joseph Martin Kaczmarek ,  Yogesh Ramesh Vedpathak

IPC: G06F9/46 ,  G06F3/06 ,  H04L29/08 ,  G06F11/10 ,  G06F9/48 ,  G06F12/14 ,  G06F21/31 ,  G06F21/62

CPC classification number: G06F3/0604 ,  G06F3/0611 ,  G06F3/0647 ,  G06F3/0655 ,  G06F3/0665 ,  G06F3/067 ,  G06F3/0689 ,  G06F9/4881 ,  G06F11/1076 ,  G06F12/1458 ,  G06F17/30067 ,  G06F17/30194 ,  G06F21/31 ,  G06F21/6272 ,  G06F2003/0698 ,  G06F2211/1028 ,  G06F2212/1052 ,  G06F2212/154 ,  G06F2221/2149 ,  H04L67/1002 ,  H04L67/1095 ,  H04L67/1097 ,  H04L67/145

Abstract: A method includes a set of execution units of a dispersed storage network (DSN) receiving sets of sub-task requests from a computing device and storing the sets of sub-task requests, where each execution unit stores a request of each of the sets of sub-task requests to produce a corresponding plurality of sub-task requests. The method continues with each execution unit generating sub-task estimation data and adjusting timing, sequencing, or processing of the corresponding plurality of sub-task requests based on the estimation data to produce a plurality of partial results, where, due to one or more difference factors from a list of difference factors, the execution units process pluralities of sub-task requests at difference paces, where the list of difference factors includes differences in amounts of data to be processed per sub-task request, processing capabilities, memory storage capabilities, and networking capabilities.

Abstract translation: 一种方法包括：分散存储网络（DSN）的一组执行单元，其接收来自计算设备的子任务请求集合并且存储所述子任务请求集合，其中每个执行单元存储每个所述一组 子任务请求产生相应的多个子任务请求。 该方法继续执行单元生成子任务估计数据，并且基于估计数据调整对应的多个子任务请求的定时，排序或处理以产生多个部分结果，其中由于一个或多个 不同因素的差异因素，执行单元处理不同步骤的多个子任务请求，其中不同因素的列表包括每个子任务请求要处理的数据量的差异，处理能力，存储器存储能力 和网络功能。

公开(公告)号：US09521197B2

公开(公告)日：2016-12-13

申请号：US14056015

申请日：2013-10-17

Applicant: CLEVERSAFE, INC.

Inventor： Wesley Leggette ,  Jason K. Resch ,  Yogesh Ramesh Vedpathak ,  Sebastien Vas ,  Eric Gunnar Smith ,  Adam Michael Gray

IPC: G06F15/16 ,  H04L29/08 ,  G06F11/10 ,  G06F3/06

CPC classification number: H04L67/1097 ,  G06F3/0604 ,  G06F3/0619 ,  G06F3/064 ,  G06F3/065 ,  G06F3/067 ,  G06F11/1076 ,  G06F11/1092 ,  G06F2211/1028

Abstract: A method begins by a dispersed storage (DS) processing module dividing a very large data object into a plurality of data regions and generating a data object storage tracking table that includes sections for identifying one or more data regions that are available or unavailable for retrieval. The method continues with the DS processing module dividing a first data region into data segments and disperse storage error encoding the data segments to produce sets of encoded data slices. The method continues with the DS processing module sending DSN write requests regarding storing the sets of encoded data slices to storage units and when at least a write threshold number of write responses is received for each of the sets of encoded data slices, updating the data object storage tracking table to indicate that the first data region is available for retrieval.

Abstract translation: 一种分散存储（DS）处理模块开始的方法是将非常大的数据对象分成多个数据区域，并且生成包括用于识别一个或多个可用或不可用于检索的数据区域的数据对象存储跟踪表。 该方法继续DS处理模块将第一数据区域划分成数据段并且分散对数据段进行编码的存储错误以产生编码数据片段。 该方法继续，DS处理模块发送关于将编码数据片段集合存储到存储单元的DSN写入请求，并且当为每组编码数据片段接收至少写入阈值数量的写入响应时，更新数据对象 存储跟踪表以指示第一数据区域可用于检索。

公开(公告)号：US20150356305A1

公开(公告)日：2015-12-10

申请号：US14675070

申请日：2015-03-31

Applicant: CLEVERSAFE, INC.

Inventor： Ilya Volvovski ,  Bruno Hennig Cabral ,  Manish Motwani ,  Thomas Darrel Cocagne ,  Timothy W. Markison ,  Gary W. Grube ,  Wesley Leggette ,  Jason K. Resch ,  Michael Colin Storm ,  Greg Dhuse ,  Yogesh Ramesh Vedpathak ,  Ravi Khadiwala

IPC: G06F21/60 ,  G06F21/62 ,  H04L9/08 ,  H04L29/08

CPC classification number: G06F21/602 ,  G06F11/1076 ,  G06F11/1464 ,  G06F11/2094 ,  G06F16/21 ,  G06F16/22 ,  G06F16/27 ,  G06F21/6218 ,  G06F2201/84 ,  H04L9/0861 ,  H04L9/0897 ,  H04L67/10 ,  H04L67/1097 ,  H04L69/04

Abstract: A method begins by a processing module of a dispersed storage network (DSN) dividing data into a plurality of data units and generating a plurality of encryption keys from a master key associated with the data and a data identifier associated with the data. The method continues with the processing module encrypting the plurality of data units using the plurality of encryption keys to produce a plurality of encrypted data units and sending the plurality of encrypted data units to a first set of storage units of the DSN for storage. The method continues with the processing module encoding the master key to produce a plurality of encoded master key units and sending the plurality of encoded master key units to a second set of storage units of the DSN for storage.

Abstract translation: 一种方法由分散存储网络（DSN）的处理模块开始，分散存储网络（DSN）将数据分割成多个数据单元，并从与数据相关联的主密钥和与数据相关联的数据标识符生成多个加密密钥。 该方法继续处理模块使用多个加密密钥加密多个数据单元以产生多个加密数据单元，并将多个加密数据单元发送到DSN的第一组存储单元用于存储。 该方法继续处理模块编码主密钥以产生多个编码的主密钥单元，并将多个编码的主密钥单元发送到DSN的第二组存储单元用于存储。

公开(公告)号：US20150355979A1

公开(公告)日：2015-12-10

申请号：US14675183

申请日：2015-03-31

Applicant: CLEVERSAFE, INC.

Inventor： Ilya Volvovski ,  Bruno Hennig Cabral ,  Manish Motwani ,  Thomas Darrel Cocagne ,  Timothy W. Markison ,  Gary W. Grube ,  Wesley Leggette ,  Jason K. Resch ,  Michael Colin Storm ,  Greg Dhuse ,  Yogesh Ramesh Vedpathak ,  Ravi Khadiwala

IPC: G06F11/14 ,  H04L29/08

CPC classification number: G06F11/1464 ,  G06F17/30289 ,  G06F17/30312 ,  G06F17/30575 ,  G06F2201/84 ,  H04L67/1097 ,  H04L69/04

Abstract: A method begins by a set of storage units of a dispersed storage network (DSN) storing a plurality of encoded data slices, where each storage unit stores a unique sub-set of encoded data slices. The method continues with each storage unit dispersed storage error encoding at least a recovery threshold number of encoded data slices to produce a local set of encoded recovery data slices. In response to a retrieval request, the method continues with a device identifying a storage unit of an initial recovery number of storage units having a rebuilding issue and determining whether the rebuilding issue is correctable at a DSN level. When the rebuilding issue is correctable at the DSN level the method continues with the device selecting another storage unit to replace the storage unit to produce a recovery number of storage units and sending retrieve requests to the recovery number of storage units.

Abstract translation: 方法由存储多个编码数据片的分散存储网络（DSN）的一组存储单元开始，其中每个存储单元存储编码数据片的唯一子集。 该方法继续每个存储单元分散存储错误编码至少恢复阈值数量的编码数据片以产生本地编码恢复数据片段集合。 响应于检索请求，该方法继续识别具有重建问题的存储单元的初始恢复数量的存储单元的设备，并且确定重建问题是否在DSN级别是可校正的。 当重建问题在DSN级别可校正时，该方法继续，设备选择另一个存储单元来替换存储单元以产生恢复数量的存储单元并且将检索请求发送到恢复数量的存储单元。