Invention Grant
- Patent Title: Redistributing data in a distributed storage system based on attributes of the data
-
Application No.: US13666709Application Date: 2012-11-01
-
Publication No.: US09229657B1Publication Date: 2016-01-05
- Inventor: Silvius V. Rus , Michael Ovsiannikov
- Applicant: Silvius V. Rus , Michael Ovsiannikov
- Applicant Address: US CA San Francisco
- Assignee: Quantcast Corporation
- Current Assignee: Quantcast Corporation
- Current Assignee Address: US CA San Francisco
- Agency: Fenwick & West LLP
- Agent Robin W. Reasoner; Renee Jacowitz
- Main IPC: G06F12/00
- IPC: G06F12/00 ; G06F3/06 ; G06F12/02

Abstract:
Accesses to a number of data blocks stored in a distributed storage are observed. Following observation of the accesses, the stored data blocks are redistributed. In one aspect, redistribution of the data blocks includes determining the access patterns for one or more of the data blocks based on the observed accesses, and determining the storage sizes for the one or more data blocks. Thereafter, based on the determined access patterns and determined storage sizes, the one or more data blocks are sorted. Subsequently, the one or more data blocks are redistributed or rebalanced across a number of storage devices of the distributed storage based on the sorting. In one aspect, the one or more data blocks are redistributed according to either a uniform distribution scheme or a proportional distribution scheme.
Information query