Invention Grant
- Patent Title: On-demand shared data caching method, computer program, and computer readable medium applicable for distributed deep learning computing
-
Application No.: US17857481Application Date: 2022-07-05
-
Publication No.: US12026096B2Publication Date: 2024-07-02
- Inventor: Yu-Bin Fang , Shuen-Tai Wang , Chau-Yi Chou
- Applicant: NATIONAL APPLIED RESEARCH LABORATORIES
- Applicant Address: TW Taipei
- Assignee: National Applied Research Laboratories
- Current Assignee: National Applied Research Laboratories
- Current Assignee Address: TW Taipei
- Agency: Rosenberg, Klein & Lee
- Priority: TW 1102661 2022.01.21
- Main IPC: G06F12/00
- IPC: G06F12/00 ; G06F12/084 ; G06N3/04

Abstract:
Disclosed are an on-demand shared data caching method, a computer program, and a computer readable medium applicable for distributed deep learning computing. The method includes a step of dynamically building a distributed shared memory cache space, in which a distributed shared memory deployment and data file access management module is added to a deep learning framework to build the distributed shared memory cache space by a memory set of a multiple of computing nodes of a cluster computer; and a distributed deep learning computing step, in which the computing node overrides a Dataset API of the deep learning framework to execute the distributed deep learning computing. When reading a data file, if the data file exists in the distributed shared memory cache space, then it will be accessed directly, or else it will be obtained from an original specified directory location and stored in the distributed shared memory cache space.
Public/Granted literature
Information query