METHOD AND SYSTEM FOR DATA TRANSFER BETWEEN COMPUTE CLUSTERS AND FILE SYSTEM
    1.
    发明申请
    METHOD AND SYSTEM FOR DATA TRANSFER BETWEEN COMPUTE CLUSTERS AND FILE SYSTEM 有权
    计算机与文件系统之间数据传输的方法和系统

    公开(公告)号:US20140351300A1

    公开(公告)日:2014-11-27

    申请号:US14045170

    申请日:2013-10-03

    CPC classification number: G06F17/303 G06F17/30194 H04L12/6418 H04L67/06

    Abstract: A data migrating system and method are provided in which a Burst Buffer Network Aggregator (BBNA) process is configured either on the File Servers or on the File System's dedicated I/O nodes to coalesce data fragments stored in participating Burst Buffer nodes under the direction of a primary BB node appointed by a data generating entity prior to transfer of the full data stripe into the File System. The “write” request in the form of a full data stripe is distributed into a plurality of data fragments among participating BB nodes along with corresponding metadata. The primary BB node gathers the metadata from the participating BB nodes, sends the metadata list to the BBNA unit, responsive to which the BBNA unit allocates a buffer sufficient to store the full data stripe, and transfers data fragments from participating BB nodes into the full data stripe buffer, thereby coalescing the data fragments into the full data stripe, which is subsequently transferred from the buffer in the BBNA unit into the File System.

    Abstract translation: 提供了一种数据迁移系统和方法,其中在文件服务器或文件系统的专用I / O节点上配置了突发缓冲区网络聚合器(BBNA)进程,以将存储在参与的突发缓冲区节点中的数据片段合并在 在将完整数据条带传送到文件系统之前由数据生成实体指定的主BB节点。 以完整数据条带形式的“写入”请求与相应的元数据一起分发到参与BB节点之间的多个数据片段中。 主BB节点从参与的BB节点收集元数据,将元数据列表发送到BBNA单元,响应于该BBNA单元分配足以存储完整数据条带的缓冲器,并将参与BB节点的数据片段传输到全部 数据条带缓冲区,从而将数据片段聚合成完整数据条带,随后将其从BBNA单元中的缓冲区传送到文件系统。

Patent Agency Ranking