-
公开(公告)号:US10185497B2
公开(公告)日:2019-01-22
申请号:US15627101
申请日:2017-06-19
Applicant: Rackspace US, Inc.
Inventor: Gregory Lee Holt , Clay Gerrard , David Patrick Goetz , Michael Barton
Abstract: An improved scalable object storage system allows multiple clusters to work together. In one embodiment, a trust and federation relationship is established between a first cluster and a second cluster. This is done by designating a first cluster as a trust root. The trust root receives contact from another cluster, and the two clusters exchange cryptographic credentials. The two clusters mutually authenticate each other based upon the credentials, and optionally relative to a third information service, and establish a service connection. Services from the remote cluster are registered as being available to the cluster designated as the trust root. Multi-cluster gateways can also be designated as the trust root, and joined clusters can be mutually untrusting. Two one-way trust and federation relationships can be set up to form a trusted bidirectional channel.
-
公开(公告)号:US09684453B2
公开(公告)日:2017-06-20
申请号:US14555289
申请日:2014-11-26
Applicant: Rackspace US, Inc.
Inventor: Gregory Lee Holt , Clay Gerrard , David Patrick Goetz , Michael Barton
CPC classification number: G06F3/0608 , G06F3/0619 , G06F3/0631 , G06F3/0641 , G06F3/0644 , G06F3/067 , G06F9/5083 , G06F17/30197 , G06F17/30575 , H04L47/80 , H04L67/10 , H04L67/1006 , H04L67/1023 , H04L67/1095 , H04L67/1097 , Y10S707/9994 , Y10S707/99953
Abstract: An improved scalable object storage system allows multiple clusters to work together. In one embodiment, a trust and federation relationship is established between a first cluster and a second cluster. This is done by designating a first cluster as a trust root. The trust root receives contact from another cluster, and the two clusters exchange cryptographic credentials. The two clusters mutually authenticate each other based upon the credentials, and optionally relative to a third information service, and establish a service connection. Services from the remote cluster are registered as being available to the cluster designated as the trust root. Multi-cluster gateways can also be designated as the trust root, and joined clusters can be mutually untrusting. Two one-way trust and federation relationships can be set up to form a trusted bidirectional channel.
-
3.
公开(公告)号:US09560093B2
公开(公告)日:2017-01-31
申请号:US14323726
申请日:2014-07-03
Applicant: Rackspace US, Inc.
Inventor: Gregory Lee Holt , Clay Gerrard , David Patrick Goetz , Michael Barton
CPC classification number: H04L65/403 , G06F3/0619 , G06F3/0626 , G06F3/0644 , G06F3/065 , G06F3/067 , G06F11/1004 , G06F11/2097 , G06F17/30153 , G06F17/30156 , G06F17/30174 , G06F17/30318 , G06F17/30371 , G06F17/30575 , G06F17/30864 , G06F17/30887 , G06F2201/85 , H04L43/106 , H04L67/06 , H04L67/1095 , H04L67/1097 , H04L67/2828 , H04L69/04
Abstract: In one embodiment, there is a multi-cluster synchronization system between two or more clusters. The multi-cluster synchronization system uses variable compression to optimize the transfer of information between the clusters. Compression is used not only to minimize the total number of bytes sent between the two clusters, but to dynamically vary the size of the objects sent across the wire to optimize for higher throughput after considering packet loss, TCP windows, and block sizes. This includes both the packaging of multiple small files together into one larger compressed file, saving on TCP and header overhead, but also the chunking of large files into multiple smaller files that are less likely to have difficulties due to intermittent network congestion or errors. A further embodiment uses forward error correction to maximize the chances that the remote end will be able to correctly reconstitute the transmission.
Abstract translation: 在一个实施例中,在两个或更多个集群之间存在多集群同步系统。 多集群同步系统使用可变压缩来优化集群之间的信息传输。 压缩不仅用于最小化两个集群之间发送的字节总数,而且可以动态地改变通过电线发送的对象的大小,以便在考虑到数据包丢失,TCP窗口和块大小后进行优化。 这包括将多个小文件打包成一个较大的压缩文件,节省TCP和头部开销,还将大文件分块到由于间歇性网络拥塞或错误而不太可能遇到困难的较小文件。 另一实施例使用前向纠错来最大化远程端将能够正确地重构传输的机会。
-
公开(公告)号:US20140304334A1
公开(公告)日:2014-10-09
申请号:US14249301
申请日:2014-04-09
Applicant: Rackspace US, Inc.
Inventor: Gregory Lee Holt , Clay Gerrard , David Patrick Goetz , Michael Barton
IPC: H04L29/06
CPC classification number: H04L65/403 , G06F3/0619 , G06F3/0626 , G06F3/0644 , G06F3/065 , G06F3/067 , G06F11/1004 , G06F11/2097 , G06F17/30153 , G06F17/30156 , G06F17/30174 , G06F17/30318 , G06F17/30371 , G06F17/30575 , G06F17/30864 , G06F17/30887 , G06F2201/85 , H04L43/106 , H04L67/06 , H04L67/1095 , H04L67/1097 , H04L67/2828 , H04L69/04
Abstract: An improved scalable object storage system includes methods and systems allowing multiple clusters to work together. Users working with a first cluster, or with a multi-cluster gateway, can ask for services and have the request or data transparently proxied to a second cluster. This gives transparent cross-cluster replication, as well as multi-cluster compute or storage farms based upon spot availability or various provisioning policies. Vendors providing a cloud storage “frontend” can provide multiple backends simultaneously. In one embodiment, a multi-cluster gateway can have a two, three, or higher-level ring that transparently matches an incoming request with the correct cluster. In the ring, a request is first mapped to an abstract “partition” based on a consistent hash function, and then one or more constrained mappings map the partition number to an actual resource. In another embodiment, the multi-cluster gateway is a dumb gateway, and the rings are located only at the cluster level.
Abstract translation: 改进的可扩展对象存储系统包括允许多个集群一起工作的方法和系统。 使用第一个集群或多集群网关的用户可以要求服务,并将请求或数据透明地代理到第二个集群。 这将提供透明的跨群集复制,以及基于现场可用性或各种配置策略的多群集计算或存储场。 提供云存储“前端”的供应商可以同时提供多个后端。 在一个实施例中,多集群网关可以具有两个,三个或更高级别的环,其使用正确的集群透明地匹配传入请求。 在环中,请求首先基于一致的哈希函数映射到抽象“分区”,然后一个或多个约束映射将分区号映射到实际资源。 在另一个实施例中,多群集网关是哑网关,而环仅位于群集级。
-
公开(公告)号:US20160269481A1
公开(公告)日:2016-09-15
申请号:US14979035
申请日:2015-12-22
Applicant: Rackspace US, Inc.
Inventor: Gregory Holt , Clay Gerrard , David Goetz , Michael Barton , Charles Thier
CPC classification number: H04L65/403 , G06F3/0619 , G06F3/0626 , G06F3/0644 , G06F3/065 , G06F3/067 , G06F11/1004 , G06F11/2097 , G06F16/1744 , G06F16/1748 , G06F16/178 , G06F16/2219 , G06F16/2365 , G06F16/27 , G06F16/951 , G06F16/9566 , G06F2201/85 , H04L43/106 , H04L67/06 , H04L67/1095 , H04L67/1097 , H04L67/2828 , H04L69/04
Abstract: An improved scalable object storage system includes methods and systems allowing multiple clusters to work together. In one embodiment, there is a multi-cluster synchronization system between two or more clusters. Each cluster has a cluster-internal network, with object storage services and container services. The container services track and replicate metadata associated with the object storage service. An intercluster network connects the two clusters and performs a one-way synchronization of the objects and metadata associated with a particular container. This can be done either through the direct association of the container and object storage services, such as through a trust and federation relationship, or it can be opaque, so that the cross-cluster replication treats the remote repository as a black box and uses the external API to call and manipulate the files. In a further embodiment, multiple synchronization relationships can be set up, either in a cycle (with two or more participants), in a line, or in a tree. For example, the multi-cluster replication could be used to transparently synchronize objects in a CDN network.
Abstract translation: 改进的可扩展对象存储系统包括允许多个集群一起工作的方法和系统。 在一个实施例中,在两个或更多个集群之间存在多集群同步系统。 每个集群都有一个集群内部网络,具有对象存储服务和容器服务。 容器服务跟踪和复制与对象存储服务相关联的元数据。 集群间网络连接两个集群,并执行与特定容器关联的对象和元数据的单向同步。 这可以通过容器和对象存储服务的直接关联来完成,例如通过信任和联合关系,或者它可以是不透明的,使得跨群集复制将远程存储库视为黑盒子,并使用 外部API来调用和操作文件。 在另一个实施例中,可以在循环(具有两个或多个参与者),一行或一个树中建立多个同步关系。 例如,多集群复制可用于透明地同步CDN网络中的对象。
-
公开(公告)号:US20160226931A9
公开(公告)日:2016-08-04
申请号:US14249301
申请日:2014-04-09
Applicant: Rackspace US, Inc.
Inventor: Gregory Lee Holt , Clay Gerrard , David Patrick Goetz , Michael Barton
IPC: H04L29/06
CPC classification number: H04L65/403 , G06F3/0619 , G06F3/0626 , G06F3/0644 , G06F3/065 , G06F3/067 , G06F11/1004 , G06F11/2097 , G06F17/30153 , G06F17/30156 , G06F17/30174 , G06F17/30318 , G06F17/30371 , G06F17/30575 , G06F17/30864 , G06F17/30887 , G06F2201/85 , H04L43/106 , H04L67/06 , H04L67/1095 , H04L67/1097 , H04L67/2828 , H04L69/04
Abstract: An improved scalable object storage system includes methods and systems allowing multiple clusters to work together. Users working with a first cluster, or with a multi-cluster gateway, can ask for services and have the request or data transparently proxied to a second cluster. This gives transparent cross-cluster replication, as well as multi-cluster compute or storage farms based upon spot availability or various provisioning policies. Vendors providing a cloud storage “frontend” can provide multiple backends simultaneously. In one embodiment, a multi-cluster gateway can have a two, three, or higher-level ring that transparently matches an incoming request with the correct cluster. In the ring, a request is first mapped to an abstract “partition” based on a consistent hash function, and then one or more constrained mappings map the partition number to an actual resource. In another embodiment, the multi-cluster gateway is a dumb gateway, and the rings are located only at the cluster level.
Abstract translation: 改进的可扩展对象存储系统包括允许多个集群一起工作的方法和系统。 使用第一个集群或多集群网关的用户可以要求服务,并将请求或数据透明地代理到第二个集群。 这将提供透明的跨群集复制,以及基于现场可用性或各种配置策略的多群集计算或存储场。 提供云存储“前端”的厂商可以同时提供多个后端。 在一个实施例中,多集群网关可以具有两个,三个或更高级别的环,其使用正确的集群透明地匹配传入请求。 在环中,请求首先基于一致的哈希函数映射到抽象“分区”,然后一个或多个约束映射将分区号映射到实际资源。 在另一个实施例中,多群集网关是哑网关,而环仅位于群集级。
-
公开(公告)号:US20150156136A1
公开(公告)日:2015-06-04
申请号:US14555289
申请日:2014-11-26
Applicant: Rackspace US, Inc.
Inventor: Gregory Lee Holt , Clay Gerrard , David Patrick Goetz , Michael Barton
IPC: H04L12/927 , H04L29/08
CPC classification number: G06F3/0608 , G06F3/0619 , G06F3/0631 , G06F3/0641 , G06F3/0644 , G06F3/067 , G06F9/5083 , G06F17/30197 , G06F17/30575 , H04L47/80 , H04L67/10 , H04L67/1006 , H04L67/1023 , H04L67/1095 , H04L67/1097 , Y10S707/9994 , Y10S707/99953
Abstract: An improved scalable object storage system allows multiple clusters to work together. In one embodiment, a trust and federation relationship is established between a first cluster and a second cluster. This is done by designating a first cluster as a trust root. The trust root receives contact from another cluster, and the two clusters exchange cryptographic credentials. The two clusters mutually authenticate each other based upon the credentials, and optionally relative to a third information service, and establish a service connection. Services from the remote cluster are registered as being available to the cluster designated as the trust root. Multi-cluster gateways can also be designated as the trust root, and joined clusters can be mutually untrusting. Two one-way trust and federation relationships can be set up to form a trusted bidirectional channel.
Abstract translation: 改进的可扩展对象存储系统允许多个集群一起工作。 在一个实施例中,在第一集群和第二集群之间建立信任和联合关系。 这是通过将第一个集群指定为信任根来完成的。 信任根接收来自另一个集群的联系人,两个集群交换加密凭据。 两个集群基于证书彼此相互认证,并且可选地相对于第三信息服务,并建立服务连接。 远程集群的服务被注册为指定为信任根的集群可用。 多集群网关也可以指定为信任根,并且连接的集群可以相互不可信。 可以设置两个单向信任和联合关系,形成可信双向通道。
-
公开(公告)号:US20170208124A1
公开(公告)日:2017-07-20
申请号:US15419478
申请日:2017-01-30
Applicant: Rackspace US, Inc.
Inventor: Gregory Lee Holt , Clay Gerrard , David Patrick Goetz , Michael Barton
CPC classification number: H04L65/403 , G06F3/0619 , G06F3/0626 , G06F3/0644 , G06F3/065 , G06F3/067 , G06F11/1004 , G06F11/2097 , G06F16/1744 , G06F16/1748 , G06F16/178 , G06F16/2219 , G06F16/2365 , G06F16/27 , G06F16/951 , G06F16/9566 , G06F2201/85 , H04L43/106 , H04L67/06 , H04L67/1095 , H04L67/1097 , H04L67/2828 , H04L69/04
Abstract: An improved scalable object storage system includes methods and systems allowing multiple clusters to work together. In one embodiment, there is a multi-cluster synchronization system between two or more clusters. The multi-cluster synchronization system uses variable compression to optimize the transfer of information between the clusters. Compression is used not only to minimize the total number of bytes sent between the two clusters, but to dynamically vary the size of the objects sent across the wire to optimize for higher throughput after considering packet loss, TCP windows, and block sizes. This includes both the packaging of multiple small files together into one larger compressed file, saving on TCP and header overhead, but also the chunking of large files into multiple smaller files that are less likely to have difficulties due to intermittent network congestion or errors. Depending on the state of the network and disks, the best size can vary. A further embodiment uses forward error correction to maximize the chances that the remote end will be able to correctly reconstitute the transmission.
-
公开(公告)号:US09405781B2
公开(公告)日:2016-08-02
申请号:US14249301
申请日:2014-04-09
Applicant: Rackspace US, Inc.
Inventor: Gregory Lee Holt , Clay Gerrard , David Patrick Goetz , Michael Barton
CPC classification number: H04L65/403 , G06F3/0619 , G06F3/0626 , G06F3/0644 , G06F3/065 , G06F3/067 , G06F11/1004 , G06F11/2097 , G06F17/30153 , G06F17/30156 , G06F17/30174 , G06F17/30318 , G06F17/30371 , G06F17/30575 , G06F17/30864 , G06F17/30887 , G06F2201/85 , H04L43/106 , H04L67/06 , H04L67/1095 , H04L67/1097 , H04L67/2828 , H04L69/04
Abstract: An improved scalable object storage system includes methods and systems allowing multiple clusters to work together. Users working with a first cluster, or with a multi-cluster gateway, can ask for services and have the request or data transparently proxied to a second cluster. This gives transparent cross-cluster replication, as well as multi-cluster compute or storage farms based upon spot availability or various provisioning policies. Vendors providing a cloud storage “frontend” can provide multiple backends simultaneously. In one embodiment, a multi-cluster gateway can have a two, three, or higher-level ring that transparently matches an incoming request with the correct cluster. In the ring, a request is first mapped to an abstract “partition” based on a consistent hash function, and then one or more constrained mappings map the partition number to an actual resource. In another embodiment, the multi-cluster gateway is a dumb gateway, and the rings are located only at the cluster level.
Abstract translation: 改进的可扩展对象存储系统包括允许多个集群一起工作的方法和系统。 使用第一个集群或多集群网关的用户可以要求服务,并将请求或数据透明地代理到第二个集群。 这将提供透明的跨群集复制,以及基于现场可用性或各种配置策略的多群集计算或存储场。 提供云存储“前端”的供应商可以同时提供多个后端。 在一个实施例中,多集群网关可以具有两个,三个或更高级别的环,其使用正确的集群透明地匹配传入请求。 在环中,请求首先基于一致的哈希函数映射到抽象“分区”,然后一个或多个约束映射将分区号映射到实际资源。 在另一个实施例中,多群集网关是哑网关,而环仅位于群集级。
-
公开(公告)号:US20170351436A1
公开(公告)日:2017-12-07
申请号:US15627101
申请日:2017-06-19
Applicant: Rackspace US, Inc.
Inventor: Gregory Lee Holt , Clay Gerrard , David Patrick Goetz , Michael Barton
IPC: G06F3/06 , G06F9/50 , G06F17/30 , H04L12/927 , H04L29/08
CPC classification number: G06F3/0608 , G06F3/0619 , G06F3/0631 , G06F3/0641 , G06F3/0644 , G06F3/067 , G06F9/5083 , G06F17/30197 , G06F17/30575 , H04L47/80 , H04L67/10 , H04L67/1006 , H04L67/1023 , H04L67/1095 , H04L67/1097 , Y10S707/9994 , Y10S707/99953
Abstract: An improved scalable object storage system allows multiple clusters to work together. In one embodiment, a trust and federation relationship is established between a first cluster and a second cluster. This is done by designating a first cluster as a trust root. The trust root receives contact from another cluster. and the two clusters exchange cryptographic credentials. The two clusters mutually authenticate each other based upon the credentials, and optionally relative to a third information service, and establish a service connection. Services from the remote cluster are registered as being available to the cluster designated as the trust root. Multi-cluster gateways can also be designated as the trust root, and joined clusters can be mutually untrusting. Two one-way trust and federation relationships can be set up to form a trusted bidirectional channel.
-
-
-
-
-
-
-
-
-