logo Idiap Research Institute        
 [BibTeX] [Marc21]
Estimating The Degree of Sleepiness by Integrating Articulatory Feature Knowledge In Raw Waveform Based CNNs
Type of publication: Idiap-RR
Citation: Fritsch_Idiap-RR-06-2019
Number: Idiap-RR-06-2020
Year: 2019
Month: 2
Institution: Idiap
Abstract: Speech-based degree of sleepiness estimation is an emerging research problem. In the literature, this problem has been mainly addressed through modeling of low level of descriptors. This paper investigates an end-to-end approach, where given raw waveform as input, a neural network estimates at its output the degree of sleepiness. Through an investigation on the continuous sleepiness sub-challenge of the INTERSPEECH 2019 Computational Paralinguistics Challenge, we show that the proposed approach consistently yields performance comparable or better than low level descriptor-based, bag-of-audio-words-based and sequence-to-sequence autoencoder feature representation-based regression systems. Furthermore, a confusion matrix analysis on the development set shows that, unlike the best baseline system, the performance of our approach is not centering around a few degrees of sleepiness, but is spread across all the degrees of sleepiness.
Projects TAPAS
Authors Fritsch, Julian
Dubagunta, S. Pavankumar
Magimai.-Doss, Mathew
Crossref by Fritsch_ICASSP_2020
Added by: [ADM]
Total mark: 0
  • Fritsch_Idiap-RR-06-2020.pdf (MD5: 5d6b990ff3832d8d888a20cc9034ee85)