REPORT Rasipuram_Idiap-RR-04-2013/IDIAP KL-HMM and Probabilistic Lexical Modeling Rasipuram, Ramya Magimai.-Doss, Mathew EXTERNAL https://publications.idiap.ch/attachments/reports/2013/Rasipuram_Idiap-RR-04-2013.pdf PUBLIC Idiap-RR-04-2013 2013 Idiap February 2013 Kullback-Leibler divergence based hidden Markov model (KL-HMM) is an approach where a posteriori probabilities of phonemes estimated by artificial neural networks (ANN) are modeled directly as feature observation. In this paper, we show the relation between standard HMM-based automatic speech recognition (ASR) approach and KL-HMM approach. More specifically, we show that KL-HMM is a probabilistic lexical modeling approach which is applicable to both HMM/GMM ASR system and hybrid HMM/ANN ASR system. Through experimental studies on DARPA Resource Management task, we show that KL-HMM approach can improve over state-of-the-art ASR system.