logo Idiap Research Institute        
 [BibTeX] [Marc21]
Multi-stream adaptive evidence combination for noise robust ASR
Type of publication: Idiap-RR
Citation: morris-RR-99-26
Number: Idiap-RR-26-1999
Year: 1999
Institution: IDIAP
Abstract: In this paper we develop different mathematical models in the framework of the multi-stream paradigm for noise robust ASR, and discuss their close relationship with human speech perception. Largely inspired by Fletcher's "product-of-errors" rule in psychoacoustics, multi-band ASR aims for robustness to data mismatch through the exploitation of spectral redundancy, while making minimum assumptions about noise type. Previous ASR tests have shown that independent sub-band processing can lead to decreased recognition performance with clean speech. We have overcome this problem by considering every combination of data sub-bands as an independent data stream. After introducing the background to multi-band ASR, we show how this "full combination" approach can be formalised, in the context of HMM/ANN based ASR, by introducing a latent variable to specify which data sub-bands in each data frame are free from data mismatch. This enables us to decompose the posterior probability for each phoneme into a reliability weighted integral over all possible positions of clean data. This approach offers great potential for adaptation to rapidly changing and unpredictable noise.
Userfields: ipdmembership={speech},
Keywords: evidence combination, multi-stream processing, noise adaptation, robust ASR
Projects Idiap
Authors Morris, Andrew
Hagen, Astrid
Glotin, Hervé
Bourlard, Hervé
Crossref by morris-spcom1.bib
Added by: [UNK]
Total mark: 0
  • rr99-26.pdf
  • rr99-26.ps.gz