Invention Grant
- Patent Title: Method and apparatus based on position relation-based skip-gram model and storage medium
-
Application No.: US16588626Application Date: 2019-09-30
-
Publication No.: US11615294B2Publication Date: 2023-03-28
- Inventor: Xiaotong Pan , Zuopeng Liu
- Applicant: Beijing Xiaomi Intelligent Technology Co., Ltd.
- Applicant Address: CN Beijing
- Assignee: Beijing Xiaomi Intelligent Technology Co., Ltd.
- Current Assignee: Beijing Xiaomi Intelligent Technology Co., Ltd.
- Current Assignee Address: CN Beijing
- Agency: Oblon, McClelland, Maier & Neustadt, L.L.P.
- Priority: CN201910113567.2 20190214
- Main IPC: G06N3/04
- IPC: G06N3/04 ; G06F40/284 ; G06F17/16

Abstract:
The present disclosure relates to a method and an apparatus based on a neural network model. The method includes acquiring a plurality of training samples, each of the training samples comprising an identifier of an input word, an identifier of an output word, and position information, wherein in one of the training samples, the output word is a context of the input word, and the position information indicates a relative position between the output word and the input word; calling a position relation-based Continuous Skip-gram Model (Skip-Gram), with each of the training samples as an input, to obtain an output result, the output result comprising a word matrix embedding of the input word, a word matrix embedding of the output word and a position matrix embedding of the position information; and updating the position relation-based Skip-Gram based on the output result to train the position relation-based Skip-Gram.
Public/Granted literature
- US20200265297A1 METHOD AND APPARATUS BASED ON NEURAL NETWORK MODELAND STORAGE MEDIUM Public/Granted day:2020-08-20
Information query