- Patent Title: Device and text representation method applied to sentence embedding
-
Application No.: US16672433Application Date: 2019-11-02
-
Publication No.: US11436414B2Publication Date: 2022-09-06
- Inventor: Fei Cai , Honghui Chen , Junxian Liu , Aimin Luo , Zhen Shu , Tao Chen , Xueshan Luo
- Applicant: Fei Cai
- Applicant Address: CN Changsha
- Assignee: Fei Cai
- Current Assignee: Fei Cai
- Current Assignee Address: CN Changsha
- Agency: Dragon Sun Law Firm, PC
- Agent Jinggao Li, Esq.; Nathaniel Perkins
- Priority: CN201811361939.5 20181115
- Main IPC: G06F40/30
- IPC: G06F40/30 ; G06N20/00 ; G06F40/211 ; G06N3/02

Abstract:
The invention discloses a device and text representation method applied to sentence embedding, which has determining a parent word and a child words set corresponding to the parent word, obtaining an hidden interaction state of parent word based on the hidden interaction state of all child words; obtaining parent word sequence corresponding to the parent word and obtaining hidden state sequence corresponding to the hidden state of parent word; obtaining the interaction representation sequence of each parent word and other parent word based on the hidden state sequence, generating sentence embeddings. The invention proposes to realize sentence embeddings through a two-level interaction representation. The two-level interaction representation is local interaction representation and a global interaction representation respectively, and combines the two-level representation to generate a hybrid interaction representation, which can improve the accuracy and efficiency of sentence embeddings and be significantly better than the Tree-LSTM model in terms of accuracy.
Public/Granted literature
- US20200159832A1 DEVICE AND TEXT REPRESENTATION METHOD APPLIED TO SENTENCE EMBEDDING Public/Granted day:2020-05-21
Information query