Invention Grant
- Patent Title: Optimizing distributed data analytics for shared storage
-
Application No.: US14814445Application Date: 2015-07-30
-
Publication No.: US09456049B2Publication Date: 2016-09-27
- Inventor: Gokul Soundararajan , Madalin Mihailescu
- Applicant: NetApp, Inc.
- Applicant Address: US CA Sunnyvale
- Assignee: NetApp, Inc.
- Current Assignee: NetApp, Inc.
- Current Assignee Address: US CA Sunnyvale
- Agency: LeClairRyan, a Professional Corporation
- Main IPC: G06F9/46
- IPC: G06F9/46 ; H04L29/08 ; G06F17/30 ; G06F9/50 ; G06F12/08

Abstract:
Methods, systems, and computer executable instructions for performing distributed data analytics are provided. In one exemplary embodiment, a method of performing a distributed data analytics job includes collecting application-specific information in a processing node assigned to perform a task to identify data necessary to perform the task. The method also includes requesting a chunk of the necessary data from a storage server based on location information indicating one or more locations of the data chunk and prioritizing the request relative to other data requests associated with the job. The method also includes receiving the data chunk from the storage server in response to the request and storing the data chunk in a memory cache of the processing node which uses a same file system as the storage server.
Public/Granted literature
- US20150334203A1 OPTIMIZING DISTRIBUTED DATA ANALYTICS FOR SHARED STORAGE Public/Granted day:2015-11-19
Information query