CONF Fougeron_INTERSPEECH_2022/IDIAP Comparison of 5 methods for the evaluation of intelligibility in mild to moderate French dysarthric speech Fougeron, Cecile Audibert, Nicolas Kodrasi, Ina Janbakhshi, Parvaneh Pernon, Michaela Leveque, Nathalie Borel, Stephanie Laganaro, Marina Bourlard, Hervé Assal, Frederic assessment method clinical application intelligibility reliability EXTERNAL http://publications.idiap.ch/attachments/papers/2022/Fougeron_INTERSPEECH_2022.pdf PUBLIC Annual Conference of the International Speech Communication Association 2022 2188-2192 2308-457X https://doi.org/10.21437/Interspeech.2022-10590 doi Altered quality of the phonetic-acoustic information in the speech signal in the case of motor speech disorders may reduce its intelligibility. Monitoring intelligibility is part of the standard clinical assessment of patients. It is also a valuable tool to index the evolution of the speech disorder. However, measuring intelligibility raises methodological debates concerning: the type of linguistic material on which the assessment is based (non-words, words, continuous speech), the evaluation protocol and type of scores (scale-based rating, transcription or recognition tests), and the advantages and disadvantages of listener vs. automatic-based approaches (subjective vs. objective, expertise level, types of models used). In this paper, the intelligibility of the speech of 32 French patients presenting mild to moderate dysarthria and 17 elderly speakers is assessed with five different methods: impressionistic clinician judgment on continuous speech, number of words recognized in an interactive face-to-face setting and in an on-line testing of the same material by 75 judges, automatic feature-based and automatic speech recognition-based methods (both on short sentences). The implications of the different methods for clinical practice are discussed.