Invention Grant
- Patent Title: Memory-based data selection scheme for machine learning training on limited memory resources
-
Application No.: US15953440Application Date: 2018-04-14
-
Publication No.: US11301776B2Publication Date: 2022-04-12
- Inventor: Celestine Duenner , Thomas P. Parnell , Charalampos Pozidis
- Applicant: International Business Machines Corporation
- Applicant Address: US NY Armonk
- Assignee: International Business Machines Corporation
- Current Assignee: International Business Machines Corporation
- Current Assignee Address: US NY Armonk
- Agency: Scully, Scott, Murphy & Presser, P.C.
- Agent Daniel P. Morris
- Main IPC: G06F15/16
- IPC: G06F15/16 ; G06F9/54 ; H04L29/06 ; G06N20/00 ; G06F9/50

Abstract:
A method for a machine learning model training is provided which operates in a mixed CPU/GPU environment. The amount of general processing unit memory is larger than the amount of special processing unit memory. The method includes loading a complete training data set into the memory of the general processing unit, determining importance values relating to training data vectors in the provided training data set of the training data vectors, dynamically transferring training data vectors of the training data set from the general processing unit memory to a special processing unit memory using as decision criteria the importance value of the training data vector, wherein the importance value used is taken from an earlier training round of the machine learning model, and executing a training algorithm on the special processing unit with the training data vectors having the highest available importance values of one of the earlier training rounds.
Public/Granted literature
- US20190318270A1 MEMORY-BASED DATA SELECTION SCHEME FOR MACHINE LEARNING TRAINING ON LIMITED MEMORY RESOURCES Public/Granted day:2019-10-17
Information query