Invention Grant
- Patent Title: Dynamic de-duplication methodologies for efficient resource utilization on de-duplication system
-
Application No.: US15727363Application Date: 2017-10-06
-
Publication No.: US10592149B1Publication Date: 2020-03-17
- Inventor: Fani Jenkins , Srikant Viswanathan , Yamini Allu
- Applicant: EMC IP Holding Company LLC
- Applicant Address: US MA Hopkinton
- Assignee: EMC IP Holding Company LLC
- Current Assignee: EMC IP Holding Company LLC
- Current Assignee Address: US MA Hopkinton
- Agency: Womble Bond Dickinson (US) LLP
- Main IPC: G06F3/06
- IPC: G06F3/06 ; G06F16/174 ; G06F11/14

Abstract:
Embodiments are described for reducing memory usage and disk I/O's for reading and writing streams in a deduplication storage system. Generations of backups of a stream can be tracked for the stream. In the first generation (first backup), stream data is ingested, segmented, and written to disk without looking up a fingerprint of each segment, to save disk I/O's and memory. After the first generation, an amount of stream data processed is tracked, and at dynamically tunable increments of data processed, a fingerprint index lookup is performed to disk. The fingerprint index is read into memory and subsequent fingerprint lookups are preformed to cache, until a next dynamically tunable fingerprint lookup to disk. The dynamically tunable increment of processed data can be randomly reset.
Information query