CONF Dubagunta_ICASSP_2019/IDIAP Segment-level training of ANNs based on acoustic confidence measures for hybrid HMM/ANN Speech Recognition Dubagunta, S. Pavankumar Magimai-Doss, Mathew confidence measures local posterior probability segment-level training. speech recognition EXTERNAL http://publications.idiap.ch/attachments/papers/2019/Dubagunta_ICASSP_2019.pdf PUBLIC Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP) 2019 We show that confidence measures estimated from local posterior probabilities can serve as objective functions for training ANNs in hybrid HMM based speech recognition systems. This leads to a segment-level training paradigm that overcomes the limitation of frame-level updates ignoring the sequence structure in speech. We propose measures that train at the state and phone segment levels, while still decoding in the conventional framework. Experimental results on multiple corpora show that such trainings not only yield better systems in terms of performance, but also give additional improvements with sequence discriminative training. These techniques generalise across front-ends and model architectures, and efficiently handle the effect of segment duration variations on the ANN training.