Abstract:
System and method for processing cache metadata from a plurality of cache devices. One or more storage systems may store data blocks to a set of storage devices, each storage system hosting and operating one or more cache devices for caching data blocks of the storage devices. Each cache device may host and implement an agent engine that collects and stores cache metadata for the cache device, the cache metadata describing caching operations of the cache device. A monitor engine receives and aggregates “raw cache metadata” from each of a plurality of cache devices and processes the raw cache metadata to produce processed cache metadata comprising normalized cache metadata (based on activity rate of a cache device), weighted cache metadata, or normalized weighted cache metadata. The processed cache metadata is used by a cache prediction engine to select data blocks for caching to one or more of the cache devices.
Abstract:
Methods, systems, and computer executable instructions for performing distributed data analytics are provided. In one exemplary embodiment, a method of performing a distributed data analytics job includes collecting application-specific information in a processing node assigned to perform a task to identify data necessary to perform the task. The method also includes requesting a chunk of the necessary data from a storage server based on location information indicating one or more locations of the data chunk and prioritizing the request relative to other data requests associated with the job. The method also includes receiving the data chunk from the storage server in response to the request and storing the data chunk in a memory cache of the processing node which uses a same file system as the storage server.
Abstract:
Technology is disclosed for managing network storage services by service level objectives (SLOs). The method receives multiple service level capability (SLC) templates; creates at least one storage service level (SSL) instance using at least one of the SLC templates; provisions a storage object located in a network storage infrastructure based on the SSL instance; and services storage requests using the storage object.
Abstract:
A change in workload characteristics detected at one tier of a multi-tiered cache is communicated to another tier of the multi-tiered cache. Multiple caching elements exist at different tiers, and at least one tier includes a cache element that is dynamically resizable. The communicated change in workload characteristics causes the receiving tier to adjust at least one aspect of cache performance in the multi-tiered cache. In one aspect, at least one dynamically resizable element in the multi-tiered cache is resized responsive to the change in workload characteristics.
Abstract:
Collaborative management of shared resources is implemented by a storage server receiving, from a first resource manager, notification of a violation for a service provided by the storage server or device coupled to the storage server. The storage server further receives, from each of a plurality of resource managers, an estimated cost of taking a corrective action to mitigate the violation and selects a corrective action proposed by one of the plurality of resource managers based upon the estimated cost. The storage server directs the resource manager that proposed the selected corrective action to perform the selected corrective action.