logo Idiap Research Institute        
 [BibTeX] [Marc21]
Probabilistic Amplitude Demodulation Features in Speech Synthesis for Improving Prosody
Type of publication: Conference paper
Citation: Lazaridis_IS2016
Publication status: Published
Booktitle: Proceedings of Interspeech
Year: 2016
Location: San Francisco, USA
Crossref: Lazaridis_Idiap-RR-12-2016:
Abstract: Amplitude demodulation (AM) is a signal decomposition technique by which a signal can be decomposed to a product of two signals, i.e, a quickly varying carrier and a slowly varying modulator. In this work, the probabilistic amplitude demodulation (PAD) features are used to improve prosody in speech synthesis. The PAD is applied iteratively for generating syllable and stress amplitude modulations in a cascade manner. The PAD features are used as a secondary input scheme along with the standard text-based input features in statistical parametric speech synthesis. Specifically, deep neural network (DNN)-based speech synthesis is used to evaluate the importance of these features. Objective evaluation has shown that the proposed system using the PAD features has improved mainly prosody modelling; it outperforms the baseline system by approximately 5% in terms of relative reduction in root mean square error (RMSE) of the fundamental frequency (F0). The significance of this improvement is validated by subjective evaluation of the overall speech quality, achieving 38.6% over 19.5% preference score in respect to the baseline system, in an ABX test.
Keywords: deep neural networks, probabilistic amplitude demodulation, speech prosody, speech synthesis
Projects Idiap
Authors Lazaridis, Alexandros
Cernak, Milos
Garner, Philip N.
Added by: [UNK]
Total mark: 0
  • Lazaridis_IS2016.pdf