公开(公告)号：US20230385157A1

公开(公告)日：2023-11-30

申请号：US18325853

申请日：2023-05-30

Applicant: Cloudera, Inc.

Inventor： Prashant Pogde ,  Siddharth Wagle ,  Siyao Meng ,  Nandakumar Vadivelu ,  Sadanand Shenoy

IPC: G06F11/14 ,  G06F16/11 ,  G06F16/13 ,  G06F16/182 ,  G06F16/178

CPC classification number: G06F11/1458 ,  G06F16/122 ,  G06F16/134 ,  G06F16/1844 ,  G06F16/178 ,  G06F2201/84

Abstract: Snapshot or point-in-time image functionality improves the use of object-based datastores. An example system includes an object-based datastore and a metadata datastore associated with the object-based datastore. Instances of the metadata datastore are created as snapshot images of the object-based datastore. Comparison of snapshot images is important for database analytics, disaster recovery, data protection, and more. Example techniques provide comparison of snapshot images (as metadata datastore instances) and remain robust and accurate in view of compactions performed by the metadata datastore. An example technique includes generating and updating a graph-based data structure that captures relationships between metadata files in the metadata datastore, particularly between pre-compaction files and post-compaction files. The example technique further includes referencing the graph-based data structure to accelerate snapshot image comparison based on determining whether files of a source snapshot image were compacted into files of a destination snapshot image, and/or vice versa.