Invention Grant
- Patent Title: Background format optimization for enhanced queries in a distributed computing cluster
-
Application No.: US16921558Application Date: 2020-07-06
-
Publication No.: US11630830B2Publication Date: 2023-04-18
- Inventor: Marcel Kornacker , Justin Erickson , Nong Li , Lenni Kuff , Henry Noel Robinson , Alan Choi , Alex Behm
- Applicant: Cloudera, Inc.
- Applicant Address: US CA Palo Alto
- Assignee: Cloudera, Inc.
- Current Assignee: Cloudera, Inc.
- Current Assignee Address: US CA Palo Alto
- Agency: Perkins Coie LLP
- Main IPC: G06F16/2458
- IPC: G06F16/2458 ; G06F16/25 ; G06F16/27 ; G06F16/2453

Abstract:
A format conversion engine for Apache Hadoop that converts data from its original format to a database-like format at certain time points for use by a low latency (LL) query engine. The format conversion engine comprises a daemon that is installed on each data node in a Hadoop cluster. The daemon comprises a scheduler and a converter. The scheduler determines when to perform the format conversion and notifies the converter when the time comes. The converter converts data on the data node from its original format to a database-like format for use by the low latency (LL) query engine.
Public/Granted literature
- US20200334247A1 BACKGROUND FORMAT OPTIMIZATION FOR ENHANCED QUERIES IN A DISTRIBUTED COMPUTING CLUSTER Public/Granted day:2020-10-22
Information query