Invention Grant
- Patent Title: Layer trajectory long short-term memory with future context
-
Application No.: US16410659Application Date: 2019-05-13
-
Publication No.: US11631399B2Publication Date: 2023-04-18
- Inventor: Jinyu Li , Vadim Mazalov , Changliang Liu , Liang Lu , Yifan Gong
- Applicant: Microsoft Technology Licensing, LLC
- Applicant Address: US WA Redmond
- Assignee: Microsoft Technology Licensing, LLC
- Current Assignee: Microsoft Technology Licensing, LLC
- Current Assignee Address: US WA Redmond
- Agency: Workman Nydegger
- Main IPC: G10L15/16
- IPC: G10L15/16 ; G10L15/22 ; G10L15/183

Abstract:
According to some embodiments, a machine learning model may include an input layer to receive an input signal as a series of frames representing handwriting data, speech data, audio data, and/or textual data. A plurality of time layers may be provided, and each time layer may comprise a uni-directional recurrent neural network processing block. A depth processing block may scan hidden states of the recurrent neural network processing block of each time layer, and the depth processing block may be associated with a first frame and receive context frame information of a sequence of one or more future frames relative to the first frame. An output layer may output a final classification as a classified posterior vector of the input signal. For example, the depth processing block may receive the context from information from an output of a time layer processing block or another depth processing block of the future frame.
Public/Granted literature
- US20200334526A1 LAYER TRAJECTORY LONG SHORT-TERM MEMORY WITH FUTURE CONTEXT Public/Granted day:2020-10-22
Information query