Device and text representation method applied to sentence embedding
Abstract:
The invention discloses a device and text representation method applied to sentence embedding, which has determining a parent word and a child words set corresponding to the parent word, obtaining an hidden interaction state of parent word based on the hidden interaction state of all child words; obtaining parent word sequence corresponding to the parent word and obtaining hidden state sequence corresponding to the hidden state of parent word; obtaining the interaction representation sequence of each parent word and other parent word based on the hidden state sequence, generating sentence embeddings. The invention proposes to realize sentence embeddings through a two-level interaction representation. The two-level interaction representation is local interaction representation and a global interaction representation respectively, and combines the two-level representation to generate a hybrid interaction representation, which can improve the accuracy and efficiency of sentence embeddings and be significantly better than the Tree-LSTM model in terms of accuracy.
Information query
Patent Agency Ranking
0/0