Invention Grant
- Patent Title: Manifest-based snapshots in distributed computing environments
-
Application No.: US15605205Application Date: 2017-05-25
-
Publication No.: US10776217B2Publication Date: 2020-09-15
- Inventor: Jonathan Ming-Cyn Hsieh , Matteo Bertozzi
- Applicant: Cloudera, Inc.
- Applicant Address: US CA Palo Alto
- Assignee: Cloudera, Inc.
- Current Assignee: Cloudera, Inc.
- Current Assignee Address: US CA Palo Alto
- Agency: Perkins Coie LLP
- Main IPC: G06F7/00
- IPC: G06F7/00 ; G06F17/00 ; G06F11/14 ; G06F16/27

Abstract:
Scalable architectures, systems, and services are provided herein for creating manifest-based snapshots in distributed computing environments. In some embodiments, responsive to receiving a request to create a snapshot of a data object, a master node identifies multiple slave nodes on which a data object is stored in the cloud-computing platform and creates a snapshot manifest representing the snapshot of the data object. The snapshot manifest comprises a file including a listing of multiple file names in the snapshot manifest and reference information for locating the multiple files in the distributed database system. The snapshot can be created without disrupting I/O operations, e.g., in an online mode by various region servers as directed by the master node. Additionally, a log roll approach to creating the snapshot is also disclosed in which log files are marked. The replaying of log entries can reduce the probability of causal consistency in the snapshot.
Public/Granted literature
- US20170262348A1 MANIFEST-BASED SNAPSHOTS IN DISTRIBUTED COMPUTING ENVIRONMENTS Public/Granted day:2017-09-14
Information query