Invention Grant
- Patent Title: Token embedding based on target-context pairs
-
Application No.: US16209366Application Date: 2018-12-04
-
Publication No.: US10936810B2Publication Date: 2021-03-02
- Inventor: Alexander Sobran , Bo Zhang
- Applicant: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Applicant Address: US NY Armonk
- Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Current Assignee: INTERNATIONAL BUSINESS MACHINES CORPORATION
- Current Assignee Address: US NY Armonk
- Agency: Heslin Rothenberg Farley & Mesiti PC
- Agent William Hartwell; Matthew M. Hulihan
- Main IPC: G06F40/211
- IPC: G06F40/211 ; G06F8/41 ; G06N3/08 ; G06F16/901 ; G06F40/30 ; G06F40/284

Abstract:
Token embedding based on target-context pairs includes obtaining a structural representation of data, the structural representation including nodes and indicating relationships between the nodes, obtaining a context template that identifies relationship(s) to use in identifying a respective context for different nodes of the structural representation, applying the context template to the structural representation to obtain a set of target-context pairs, each of which includes a respective target node of the structural representation and a respective set of context node(s), of the structural representation, for that target node, as identified based on the context template, and using the target-context pairs in a model and obtaining, as output of the model, representations of target nodes of the target-context pairs as vectors in a vector space.
Public/Granted literature
- US20200175102A1 TOKEN EMBEDDING BASED ON TARGET-CONTEXT PAIRS Public/Granted day:2020-06-04
Information query