Invention Grant
- Patent Title: Method and system for data transfer between compute clusters and file system
-
Application No.: US14045170Application Date: 2013-10-03
-
Publication No.: US09628299B2Publication Date: 2017-04-18
- Inventor: Pavan Kumar Uppu , Jason Micah Cope , Paul Nowoczynski , Michael Piszczek
- Applicant: DATADIRECT NETWORKS, INC.
- Applicant Address: US CA Chatsworth
- Assignee: DataDirect Networks, Inc.
- Current Assignee: DataDirect Networks, Inc.
- Current Assignee Address: US CA Chatsworth
- Agency: Rosenberg, Klein & Lee
- Main IPC: G06F13/28
- IPC: G06F13/28 ; G06F12/0866 ; H04L12/64

Abstract:
A data migrating system and method are provided in which a Burst Buffer Network Aggregator (BBNA) process is configured either on the File Servers or on the File System's dedicated I/O nodes to coalesce data fragments stored in participating Burst Buffer nodes under the direction of a primary BB node appointed by a data generating entity prior to transfer of the full data stripe into the File System. The “write” request in the form of a full data stripe is distributed into a plurality of data fragments among participating BB nodes along with corresponding metadata. The primary BB node gathers the metadata from the participating BB nodes, sends the metadata list to the BBNA unit, responsive to which the BBNA unit allocates a buffer sufficient to store the full data stripe, and transfers data fragments from participating BB nodes into the full data stripe buffer, thereby coalescing the data fragments into the full data stripe, which is subsequently transferred from the buffer in the BBNA unit into the File System.
Public/Granted literature
- US20140351300A1 METHOD AND SYSTEM FOR DATA TRANSFER BETWEEN COMPUTE CLUSTERS AND FILE SYSTEM Public/Granted day:2014-11-27
Information query