logo Idiap Research Institute        
 [BibTeX] [Marc21]
Estimating The Degree of Sleepiness by Integrating Articulatory Feature Knowledge In Raw Waveform Based CNNs
Type of publication: Conference paper
Citation: Fritsch_ICASSP_2020
Booktitle: International Conference on Acoustics, Speech, and Signal Processing (ICASSP)
Year: 2020
Month: May
Location: Barcelona, Spain
Crossref: Fritsch_Idiap-RR-06-2019:
Abstract: Speech-based degree of sleepiness estimation is an emerging research problem. This paper investigates an end-to-end approach, where given raw waveform as input, a convolutional neural network (CNN) estimates at its output the degree of sleepiness. Within this approach, we investigate constraining the first layer processing and integration of speech production knowledge through transfer learning. We evaluate these methods on the continuous sleepiness corpus of the Interspeech 2019 Computational Paralinguistics (ComParE) Challenge and demonstrate that the proposed approach consistently yields competitive systems. In particular, we observe that integration of speech production knowledge aids in improving the performance and yields systems that are complementary.
Keywords: articulatory features, Convolutional Neural Networks, end-to-end acoustic modeling, Paralinguistic speech processing, sleepiness
Projects TAPAS
Authors Fritsch, Julian
Dubagunta, S. Pavankumar
Magimai.-Doss, Mathew
Added by: [UNK]
Total mark: 0
  • Fritsch_ICASSP_2020.pdf