logo Idiap Research Institute        
 [BibTeX] [Marc21]
On the Use of Information Retrieval Measures for Speech Recognition Evaluation
Type of publication: Idiap-RR
Citation: mccowan-rr-04-73
Number: Idiap-RR-73-2004
Year: 2004
Institution: IDIAP
Address: Martigny, Switzerland
Abstract: This paper discusses the evaluation of automatic speech recognition (ASR) systems developed for practical applications, suggesting a set of criteria for application-oriented performance measures. The commonly used word error rate (WER,',','), which poses ASR evaluation as a string editing process, is shown to have a number of limitations with respect to these criteria, motivating alternative or additional measures. This paper suggests that posing speech recognition evaluation as an information retrieval problem, where each word is one unit of information, offers a flexible framework for application-oriented performance analysis based on the concepts of recall and precision.
Userfields: ipdmembership={speech, vision}, language={English},
Projects Idiap
Authors McCowan, Iain A.
Moore, Darren
Dines, John
Gatica-Perez, Daniel
Flynn, Mike
Wellner, Pierre
Bourlard, Hervé
Added by: [UNK]
Total mark: 0
  • rr04-73.pdf
  • rr04-73.ps.gz