Invention Grant
- Patent Title: Systems and methods for partially supervised learning with momentum prototypes
-
Application No.: US17005763Application Date: 2020-08-28
-
Publication No.: US12056610B2Publication Date: 2024-08-06
- Inventor: Junnan Li , Chu Hong Hoi
- Applicant: Salesforce, Inc.
- Applicant Address: US CA San Francisco
- Assignee: Salesforce, Inc.
- Current Assignee: Salesforce, Inc.
- Current Assignee Address: US CA San Francisco
- Agency: Haynes and Boone, LLP
- Main IPC: G06N3/08
- IPC: G06N3/08 ; G06F18/21 ; G06F18/214 ; G06F18/2431

Abstract:
A learning mechanism with partially-labeled web images is provided while correcting the noise labels during the learning. Specifically, the mechanism employs a momentum prototype that represents common characteristics of a specific class. One training objective is to minimize the difference between the normalized embedding of a training image sample and the momentum prototype of the corresponding class. Meanwhile, during the training process, the momentum prototype is used to generate a pseudo label for the training image sample, which can then be used to identify and remove out of distribution (OOD) samples to correct the noisy labels from the original partially-labeled training images. The momentum prototype for each class is in turn constantly updated based on the embeddings of new training samples and their pseudo labels.
Public/Granted literature
- US20220067506A1 SYSTEMS AND METHODS FOR PARTIALLY SUPERVISED LEARNING WITH MOMENTUM PROTOTYPES Public/Granted day:2022-03-03
Information query