公开(公告)号：WO2015138221A1

公开(公告)日：2015-09-17

申请号：PCT/US2015/019087

申请日：2015-03-06

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： WEI, Danny ,  LEE, Kerry Quintin ,  THOMPSON, James Michael ,  GUTHRIE, II, John Luther ,  FAN, Jianhua ,  GOPALAKRISHNAN, Nandakumar

IPC: G06F12/16

CPC classification number: G06F17/30575 ,  G06F3/0604 ,  G06F3/0611 ,  G06F3/0623 ,  G06F3/064 ,  G06F3/065 ,  G06F3/0665 ,  G06F3/067 ,  G06F3/0683 ,  G06F11/2069 ,  H04L67/1095 ,  H04L67/1097

Abstract: A block-based storage system may implement reducing durability state for a data volume. A determination may be made that storage node replicating write requests for a data volume is unavailable. In response, subsequent write requests may be processed according to a reduced durability state for the data volume such that replication for the data volume may be disabled for the storage node. Write requests may then be completed at a fewer number of storage nodes prior to acknowledging the write request as complete. Durability state for the data volume may be increase in various embodiments. A storage node may be identified and replication operations may be performed to synchronize the current data volume at the storage node with a replica of the data volume maintained at the identified storage node.

Abstract translation: 基于块的存储系统可以实现数据量的降低耐久性状态。 可以确定复制对数据卷的写入请求的存储节点不可用。 作为响应，可以根据数据卷的减少的耐久性状态来处理随后的写入请求，使得对于存储节点可以禁用数据卷的复制。 然后，在将写入请求确认为完成之前，可以在较少数量的存储节点上完成写入请求。 在各种实施例中，数据量的耐久性状态可能会增加。 可以识别存储节点，并且可以执行复制操作以使存储节点处的当前数据卷与在所识别的存储节点处维护的数据卷的副本同步。

公开(公告)号：WO2016154587A1

公开(公告)日：2016-09-29

申请号：PCT/US2016/024328

申请日：2016-03-25

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： BROOKER, Marc John ,  THOMPSON, James Michael ,  OLSON, Marc Stephen

IPC: G06F3/06

CPC classification number: G06F3/0619 ,  G06F3/0604 ,  G06F3/0631 ,  G06F3/0647 ,  G06F3/0653 ,  G06F3/0665 ,  G06F3/067 ,  G06F3/0689

Abstract: A storage system may implement dynamic configuration of data volumes. Client utilization of a data volume in a storage system may be tracked or monitored. Based on the utilization of the data volume, configuration recommendations to reconfigure the data volume according to data volume offerings may be determined. The data volume may be configured according to an authorized configuration recommendation. In some embodiments, these recommendations may be provided to a client and selection of the configuration recommendation to perform may be received. In some embodiments, a configuration recommendation may be automatically performed based on previously provided authorization to configure the data volume.

Abstract translation: 存储系统可以实现数据卷的动态配置。 可以跟踪或监视存储系统中数据卷的客户端利用。 基于数据量的利用，可以确定根据数据量产品重配置数据量的配置建议。 可以根据授权的配置建议配置数据卷。 在一些实施例中，可以将这些建议提供给客户端，并且可以接收对要执行的配置建议的选择。 在一些实施例中，可以基于先前提供的用于配置数据量的许可来自动执行配置建议。

公开(公告)号：WO2015138375A2

公开(公告)日：2015-09-17

申请号：PCT/US2015/019574

申请日：2015-03-10

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： WEI, Danny ,  GUTHRIE, II, John Luther ,  THOMPSON, James Michael ,  HAWKS, Benjamin Arthur ,  KUSTERS, Norbert P.

IPC: G06F12/08

CPC classification number: G06F12/0866 ,  G06F11/1471 ,  G06F11/3409 ,  G06F11/3485 ,  G06F12/0804 ,  G06F12/0868 ,  G06F2201/885 ,  G06F2212/1016 ,  G06F2212/1032 ,  G06F2212/313 ,  G06F2212/461

Abstract: A block-based storage system may implement page cache write logging. Write requests for a data volume maintained at a storage node may be received at a storage node. A page cache for may be updated in accordance with the request. A log record describing the page cache update may be stored in a page cache write log maintained in a persistent storage device. Once the write request is performed in the page cache and recorded in a log record in the page cache write log, the write request may be acknowledged. Upon recovery from a system failure where data in the page cache is lost, log records in the page cache write log may be replayed to restore to the page cache a state of the page cache prior to the system failure.

Abstract translation: 基于块的存储系统可以实现页面缓存写入日志记录。 可以在存储节点处接收对存储节点维护的数据卷的写入请求。 可以根据请求更新页面缓存。 描述页面高速缓存更新的日志记录可以存储在维护在永久存储设备中的页面缓存写入日志中。 一旦在页面高速缓存中执行了写入请求并将其记录在页面缓存写入日志中的日志记录中，则可以确认写入请求。 从页面缓存中的数据丢失的系统故障恢复时，可能会重播页面缓存写入日志中的日志记录，以在系统故障之前将页面缓存的状态还原到页面缓存。

公开(公告)号：WO2016145091A1

公开(公告)日：2016-09-15

申请号：PCT/US2016/021580

申请日：2016-03-09

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： BROOKER, Marc John ,  GREENWOOD, Christopher Magee ,  DHOOLAM, Surya Prakash ,  THOMPSON, James Michael ,  OLSON, Marc Stephen ,  FLAHERTY, Mitchell Gannon

IPC: G06F9/50

CPC classification number: H04L47/783 ,  G06F9/45533 ,  G06F9/5072 ,  G06F9/5083

Abstract: A distributed system may implement opportunistic resource migration to optimize resource placement. Resources may be placed amongst different resource hosts of a distributed system. An evaluation of the current placement may be performed according placement criteria that improve placement of the resources at the distributed system. Based on the evaluation, the prospective migration of resources that exceed an improvement threshold may be identified as candidate resources to migrate. Migration for the candidate resources may be opportunistically performed. In some embodiments, a priority may be assigned to the candidate resources according to which the candidate resources are selected for performing migration.

Abstract translation: 分布式系统可以实现机会资源迁移，以优化资源安置。 资源可以放置在分布式系统的不同资源主机之间。 可以根据改善在分布式系统上的资源布置的放置标准来执行当前布局的评估。 根据评估，超过改善阈值的资源的预期迁移可以被确定为迁移的候选资源。 候选资源的迁移可以机会地执行。 在一些实施例中，优先级可以被分配给候选资源，根据该候选资源选择候选资源以执行迁移。

公开(公告)号：WO2015138376A1

公开(公告)日：2015-09-17

申请号：PCT/US2015/019576

申请日：2015-03-10

Applicant: AMAZON TECHNOLOGIES, INC.

Inventor： WEI, Danny ,  LEE, Kerry Quintin ,  HE, Jiahua ,  HAWKS, Benjamin Arthur ,  GUTHRIE, II, John Luther ,  THOMPSON, James Michael

IPC: G06F15/16

CPC classification number: G06F12/0866 ,  G06F11/14 ,  G06F11/1471 ,  G06F11/3409 ,  G06F11/3485 ,  G06F12/0804 ,  G06F12/0868 ,  G06F2201/885 ,  G06F2212/1016 ,  G06F2212/1032 ,  G06F2212/313 ,  G06F2212/461 ,  G06F2212/502

Abstract: A block-based storage system may implement dynamic durability adjustment for page cache write logging. A rate of incoming write requests for data volumes maintained at a storage node may be monitored. Based, at least in part, on the rate of incoming write requests, a dynamic modification to a durability property for a data volume may be made, such as enabling page cache write logging the data volume or disabling write logging for the data volume. When incoming write requests are received, a determination may be made as to whether page cache write logging for a particular data volume is enabled. For write requests with disabled page cache write logging, the page cache may be updated and the write request may be acknowledged without storing a log record describing the update in a page cache write log.

Abstract translation: 基于块的存储系统可以实现页面缓存写入日志记录的动态耐久性调整。 可以监视在存储节点处维护的数据卷的传入写入请求的速率。 至少部分地基于传入写入请求的速率，可以对数据卷的耐久性属性进行动态修改，例如使页面缓存写入记录数据卷或禁用数据卷的写日志记录。 当接收到进入的写入请求时，可以确定是否启用特定数据卷的页面缓存写入日志记录。 对于具有禁用页面缓存写入日志记录的写入请求，可以更新页面缓存，并且可以确认写入请求，而不将描述更新的日志记录存储在页面缓存写入日志中。

公开(公告)号：EP3268860A1

公开(公告)日：2018-01-17

申请号：EP16711747.2

申请日：2016-03-09

Applicant: Amazon Technologies, Inc.

Inventor： BROOKER, Marc John ,  GREENWOOD, Christopher Magee ,  DHOOLAM, Surya Prakash ,  THOMPSON, James Michael ,  OLSON, Marc Stephen ,  FLAHERTY, Mitchell Gannon

IPC: G06F9/50

CPC classification number: H04L47/783 ,  G06F9/45533 ,  G06F9/5072 ,  G06F9/5083

Abstract: A distributed system may implement opportunistic resource migration to optimize resource placement. Resources may be placed amongst different resource hosts of a distributed system. An evaluation of the current placement may be performed according placement criteria that improve placement of the resources at the distributed system. Based on the evaluation, the prospective migration of resources that exceed an improvement threshold may be identified as candidate resources to migrate. Migration for the candidate resources may be opportunistically performed. In some embodiments, a priority may be assigned to the candidate resources according to which the candidate resources are selected for performing migration.

公开(公告)号：EP3117325A2

公开(公告)日：2017-01-18

申请号：EP15761091.6

申请日：2015-03-10

Applicant: Amazon Technologies, Inc.

Inventor： WEI, Danny ,  GUTHRIE, II, John Luther ,  THOMPSON, James Michael ,  HAWKS, Benjamin Arthur ,  KUSTERS, Norbert P.

IPC: G06F12/08

CPC classification number: G06F12/0866 ,  G06F11/1471 ,  G06F11/3409 ,  G06F11/3485 ,  G06F12/0804 ,  G06F12/0868 ,  G06F2201/885 ,  G06F2212/1016 ,  G06F2212/1032 ,  G06F2212/313 ,  G06F2212/461

Abstract: A block-based storage system may implement page cache write logging. Write requests for a data volume maintained at a storage node may be received at a storage node. A page cache for may be updated in accordance with the request. A log record describing the page cache update may be stored in a page cache write log maintained in a persistent storage device. Once the write request is performed in the page cache and recorded in a log record in the page cache write log, the write request may be acknowledged. Upon recovery from a system failure where data in the page cache is lost, log records in the page cache write log may be replayed to restore to the page cache a state of the page cache prior to the system failure.

Abstract translation: 基于块的存储系统可以实现页面缓存写入日志记录。 可以在存储节点处接收对存储节点维护的数据卷的写入请求。 可以根据请求更新页面缓存。 描述页面高速缓存更新的日志记录可以存储在维护在永久存储设备中的页面缓存写入日志中。 一旦在页面高速缓存中执行写入请求并且被记录在页面高速缓存写入日志中的日志记录中，则可以确认写入请求。 从页面缓存中的数据丢失的系统故障恢复时，可能会重播页面缓存写入日志中的日志记录，以在系统故障之前将页面缓存的状态还原到页面缓存。

公开(公告)号：EP3274804A1

公开(公告)日：2018-01-31

申请号：EP16715950.8

申请日：2016-03-25

Applicant: Amazon Technologies, Inc.

Inventor： BROOKER, Marc John ,  THOMPSON, James Michael ,  OLSON, Marc Stephen

IPC: G06F3/06

CPC classification number: G06F3/0619 ,  G06F3/0604 ,  G06F3/0631 ,  G06F3/0647 ,  G06F3/0653 ,  G06F3/0665 ,  G06F3/067 ,  G06F3/0689

Abstract: A storage system may implement dynamic configuration of data volumes. Client utilization of a data volume in a storage system may be tracked or monitored. Based on the utilization of the data volume, configuration recommendations to reconfigure the data volume according to data volume offerings may be determined. The data volume may be configured according to an authorized configuration recommendation. In some embodiments, these recommendations may be provided to a client and selection of the configuration recommendation to perform may be received. In some embodiments, a configuration recommendation may be automatically performed based on previously provided authorization to configure the data volume.

公开(公告)号：EP3117326A1

公开(公告)日：2017-01-18

申请号：EP15760637.7

申请日：2015-03-06

Applicant: Amazon Technologies, Inc.

Inventor： WEI, Danny ,  LEE, Kerry Quintin ,  THOMPSON, James Michael ,  GUTHRIE, II John Luther ,  FAN, Jianhua ,  GOPALAKRISHNAN, Nandakumar

IPC: G06F12/16

CPC classification number: G06F17/30575 ,  G06F3/0604 ,  G06F3/0611 ,  G06F3/0623 ,  G06F3/064 ,  G06F3/065 ,  G06F3/0665 ,  G06F3/067 ,  G06F3/0683 ,  G06F11/2069 ,  H04L67/1095 ,  H04L67/1097

Abstract: A block-based storage system may implement reducing durability state for a data volume. A determination may be made that storage node replicating write requests for a data volume is unavailable. In response, subsequent write requests may be processed according to a reduced durability state for the data volume such that replication for the data volume may be disabled for the storage node. Write requests may then be completed at a fewer number of storage nodes prior to acknowledging the write request as complete. Durability state for the data volume may be increase in various embodiments. A storage node may be identified and replication operations may be performed to synchronize the current data volume at the storage node with a replica of the data volume maintained at the identified storage node.

Abstract translation: 基于块的存储系统可以实现数据量的降低耐久性状态。 可以确定复制对数据卷的写入请求的存储节点不可用。 作为响应，可以根据数据卷的减少的耐久性状态来处理随后的写入请求，使得对于存储节点可以禁用数据卷的复制。 然后，在将写入请求确认为完成之前，可以在较少数量的存储节点上完成写入请求。 在各种实施例中，数据量的耐久性状态可能会增加。 可以识别存储节点，并且可以执行复制操作以使存储节点处的当前数据卷与在所识别的存储节点处维护的数据卷的副本同步。

公开(公告)号：EP3117331A1

公开(公告)日：2017-01-18

申请号：EP15760756.5

申请日：2015-03-10

Applicant: Amazon Technologies, Inc.

Inventor： WEI, Danny ,  LEE, Kerry Quintin ,  HE, Jiahua ,  HAWKS, Benjamin Arthur ,  GUTHRIE, II, John Luther ,  THOMPSON, James Michael

IPC: G06F15/16

CPC classification number: G06F12/0866 ,  G06F11/14 ,  G06F11/1471 ,  G06F11/3409 ,  G06F11/3485 ,  G06F12/0804 ,  G06F12/0868 ,  G06F2201/885 ,  G06F2212/1016 ,  G06F2212/1032 ,  G06F2212/313 ,  G06F2212/461 ,  G06F2212/502

Abstract: A block-based storage system may implement dynamic durability adjustment for page cache write logging. A rate of incoming write requests for data volumes maintained at a storage node may be monitored. Based, at least in part, on the rate of incoming write requests, a dynamic modification to a durability property for a data volume may be made, such as enabling page cache write logging the data volume or disabling write logging for the data volume. When incoming write requests are received, a determination may be made as to whether page cache write logging for a particular data volume is enabled. For write requests with disabled page cache write logging, the page cache may be updated and the write request may be acknowledged without storing a log record describing the update in a page cache write log.

Abstract translation: 基于块的存储系统可以实现页面缓存写入日志的动态持久性调整。 可以监视在存储节点处维护的数据卷的传入写入请求的速率。 至少部分地基于传入写入请求的速率，可以对数据卷的耐久性属性进行动态修改，例如使能页面缓存写入记录数据卷或禁用数据卷的写日志。 当接收到进入的写入请求时，可以确定是否启用特定数据卷的页面缓存写入日志记录。 对于具有禁用页面缓存写入日志记录的写请求，可以更新页面缓存，并且可以确认写入请求，而不将描述更新的日志记录存储在页面缓存写入日志中。