Invention Grant
- Patent Title: Streaming contextual unidirectional models
-
Application No.: US16516849Application Date: 2019-07-19
-
Publication No.: US11244673B2Publication Date: 2022-02-08
- Inventor: Jinyu Li , Amit Kumar Agarwal , Yifan Gong , Harini Kesavamoorthy , Changliang Liu , Liang Lu
- Applicant: MICROSOFT TECHNOLOGY LICENSING, LLC
- Applicant Address: US WA Redmond
- Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
- Current Assignee: MICROSOFT TECHNOLOGY LICENSING, LLC
- Current Assignee Address: US WA Redmond
- Agency: Workman Nydegger
- Main IPC: G10L15/16
- IPC: G10L15/16 ; G10L15/14 ; G06F40/149 ; G06N3/04

Abstract:
Streaming machine learning unidirectional models is facilitated by the use of embedding vectors. Processing blocks in the models apply embedding vectors as input. The embedding vectors utilize context of future data (e.g., data that is temporally offset into the future within a data stream) to improve the accuracy of the outputs generated by the processing blocks. The embedding vectors cause a temporal shift between the outputs of the processing blocks and the inputs to which the outputs correspond. This temporal shift enables the processing blocks to apply the embedding vector inputs from processing blocks that are associated with future data.
Public/Granted literature
- US20210020166A1 STREAMING CONTEXTUAL UNIDIRECTIONAL MODELS Public/Granted day:2021-01-21
Information query