Invention Grant
- Patent Title: Method of training model, method of determining word vector, device, medium, and product
-
Application No.: US17564369Application Date: 2021-12-29
-
Publication No.: US12277397B2Publication Date: 2025-04-15
- Inventor: Chao Ma , Jingshuai Zhang , Qifan Huang , Kaichun Yao , Peng Wang , Hengshu Zhu
- Applicant: Beijing Baidu Netcom Science Technology Co., Ltd.
- Applicant Address: CN Beijing
- Assignee: Beijing Baidu Netcom Science Technology Co., Ltd.
- Current Assignee: Beijing Baidu Netcom Science Technology Co., Ltd.
- Current Assignee Address: CN Beijing
- Agency: Keating & Bennett, LLP
- Priority: CN202110277972.5 20210315
- Main IPC: G06F40/40
- IPC: G06F40/40 ; G06F40/30 ; G06N7/01

Abstract:
A method of training a model, a method of determining a word vector, a device, a medium, and a product are provided, which may be applied to fields of natural language processing, information processing, etc. The method includes: acquiring a first word vector set corresponding to a first word set; and generating a reduced-dimensional word vector for each word vector in the first word vector set based on a word embedding model, generating, for other word vector in the first word vector set, a first probability distribution in the first word vector set based on the reduced-dimensional word vector, and adjusting a parameter of the word embedding model so as to minimize a difference between the first probability distribution and a second probability distribution for the other word vector determined by a number of word vector in the first word vector set.
Public/Granted literature
- US20220121826A1 METHOD OF TRAINING MODEL, METHOD OF DETERMINING WORD VECTOR, DEVICE, MEDIUM, AND PRODUCT Public/Granted day:2022-04-21
Information query