• Patent Title: Method and system for configuring a write amplification factor of a storage engine based on a compaction value associated with a data file
  • Application No.: US16235319
    Application Date: 2018-12-28
  • Publication No.: US11237744B2
    Publication Date: 2022-02-01
  • Inventor: Arjun Mannaly
  • Applicant: Oath Inc.
  • Applicant Address: US NY New York
  • Assignee: Oath Inc.
  • Current Assignee: Oath Inc.
  • Current Assignee Address: US NY New York
  • Agency: Venable LLP
  • Main IPC: G06F3/06
  • IPC: G06F3/06 G06F16/22 G06F16/23
Method and system for configuring a write amplification factor of a storage engine based on a compaction value associated with a data file
Abstract:
A method, system and non-transitory computer-readable medium for operating a storage engine are disclosed. With respect to a data file, a compaction value is obtained and a counter is retrieved. The compaction value indicates the minimum number of valid records in the data file for a clean-up process to be initiated. In response to the counter satisfying a first criterion, a determination is made, for each record in the data file, as to whether the record is written to another data file based on the record satisfying a second criterion. A write amplification factor of the storage engine is determined based on the compaction value. The counter indicates the number of records in the data file that are invalid. The write amplification factor and a space amplification factor are configurable; the storage engine may be tuned based on workloads, desired write throughput, desired storage utilization, and bandwidth of a storage device.
Public/Granted literature
Information query
Patent Agency Ranking
0/0