REPORT bourlard-03-48/IDIAP Comparison and Combination of Features in a Hybrid HMM/MLP and a HMM/GMM Speech Recognition System Pujol, Pere Pol, Susagna Nadeu, Climent Hagen, Astrid Bourlard, Hervé EXTERNAL http://publications.idiap.ch/attachments/reports/2003/rr03-48.pdf PUBLIC Idiap-RR-48-2003 2003 IDIAP IEEE Transactions on Speech and Audio Processing Recently, the advantages of the spectral parameters obtained by frequency filtering (FF) of the logarithmic filter-bank energies (logFBEs) have been reported. These parameters, which are frequency derivatives of the lofFBEs, lie in the frequency domain, and have shown good recognition performance with repect to the conventional MFCCs for HMM systems. In this paper, the FF features are first compared with the MFCCs and the Rasta-PLP features using both a hybrid HMM/MLP and a usual HMM/GMM recognition system, for both clean and noisy speech. Taking advantage of the ability of the hybrid system to deal with correlated features, the inclusion of both the frequency second-derivatives and the raw logFBes as additional features is proposed and tested. Moreover, the robustness of these features in noisy conditions is enhanced by combining the FF technique with the Rasta temporal filtering approach. Finally, a study of the FF features in the framework of multi-stram processing is presented. The best recognition results for both clean and noisy speech are obtained from the multi-stream combination of the J-Rasta-PLP features and the FF features.