Invention Grant
- Patent Title: Recurrent neural network training method, computer program therefor and speech recognition device
-
Application No.: US15570801Application Date: 2016-05-10
-
Publication No.: US10467525B2Publication Date: 2019-11-05
- Inventor: Naoyuki Kanda
- Applicant: National Institute of Information and Communications Technology
- Applicant Address: JP Tokyo
- Assignee: National Institute of Information and Communications Technology
- Current Assignee: National Institute of Information and Communications Technology
- Current Assignee Address: JP Tokyo
- Agency: Renner, Otto, Boisselle & Sklar, LLP
- Priority: JP2015-096150 20150511
- International Application: PCT/JP2016/063817 WO 20160510
- International Announcement: WO2016/181951 WO 20161117
- Main IPC: G06N3/04
- IPC: G06N3/04 ; G06N3/08 ; G10L15/06 ; G10L15/16

Abstract:
[Object] An object is to provide a training method of improving training of a recurrent neural network (RNN) using time-sequential data.[Solution] The training method includes a step 220 of initializing the RNN, and a training step 226 of training the RNN by designating a certain vector as a start position and optimizing various parameters to minimize error function. The training step 226 includes: an updating step 250 of updating RNN parameters through Truncated BPTT using consecutive N (N≥3) vectors having a designated vector as a start point and using a reference value of a tail vector as a correct label; and a first repetition step 240 of repeating the process of executing the training step by newly designating a vector at a position satisfying a prescribed relation with the tail of N vectors used at the updating step until an end condition is satisfied. The vector at a position satisfying the prescribed relation is positioned at least two vectors behind the designated vector.
Public/Granted literature
- US20180121800A1 RECURRENT NEURAL NETWORK TRAINING METHOD, COMPUTER PROGRAM THEREFOR AND SPEECH RECOGNITION DEVICE Public/Granted day:2018-05-03
Information query