logo Idiap Research Institute        
 [BibTeX] [Marc21]
Exploiting foreign resources for DNN-based ASR
Type of publication: Idiap-RR
Citation: Motlicek_Idiap-RR-27-2015
Number: Idiap-RR-27-2015
Year: 2015
Month: 7
Institution: Idiap
Address: Rue Marconi 19
Abstract: Manual transcription of audio databases for the development of automatic speech recognition (ASR) systems is a costly and time-consuming process. In the context of deriving acoustic models adapted to a specific application, or in low-resource scenarios, it is therefore essential to explore alternatives capable of improving speech recognition results. In this paper, we investigate the relevance of foreign data characteristics, in particular domain and language, when using this data as an auxiliary data source for training ASR acoustic models based on deep neural networks (DNNs). The acoustic models are evaluated on a challenging bilingual database within the scope of the MediaParl project. Experimental results suggest that in-language (but out-of-domain) data is more beneficial than in-domain (but out-of-language) data when employed in either supervised or semi-supervised training of DNNs. The best performing ASR system, an HMM/GMM acoustic model that exploits DNN as a discriminatively trained feature extractor outperforms the best performing HMM/DNN hybrid by about 5% relative (in terms of WER). An accumulated relative gain with respect to the MFCC-HMM/GMM baseline is about 30% WER.
Keywords: Acoustic model adaptation, Automatic Speech Recognition, Deep learning for speech, Semi-supervised training
Projects Idiap
Authors Motlicek, Petr
Imseng, David
Potard, Blaise
Garner, Philip N.
Himawan, Ivan
Crossref by Motlicek_EURASIP_2015
Added by: [ADM]
Total mark: 0
  • Motlicek_Idiap-RR-27-2015.pdf (MD5: 6705cc78111c9a1c6d46ccfe90eb3622)