Invention Grant
- Patent Title: System and method for scouting distributed file system metadata
-
Application No.: US16020452Application Date: 2018-06-27
-
Publication No.: US11036680B2Publication Date: 2021-06-15
- Inventor: Plamen Jeliazkov
- Applicant: PayPal, Inc.
- Applicant Address: US CA San Jose
- Assignee: PayPal, Inc.
- Current Assignee: PayPal, Inc.
- Current Assignee Address: US CA San Jose
- Agency: Haynes and Boone, LLP
- Main IPC: G06F16/14
- IPC: G06F16/14 ; G06F16/182

Abstract:
Aspects of the present disclosure involve, a customizable system and infrastructure which can used to retrieve and scout metadata on a distributed file system for data management. In one embodiment, a system is introduced which can be used to scout metadata from a distributed file system using an isolated node which can enable the determination and response to customized queries. The customizable system can include a NameNodeAnalytics module which can stream, filter, and process client queries without locking the NameNode in the distributed file system. In another embodiment, the analytics distributed file system can communicate with a streaming API and other time-series module for the reporting and visual representation of the metrics obtained.
Information query