ARTICLE Dubagunta_CSL_2022/IDIAP Adjustable Deterministic Pseudonymization of Speech Dubagunta, S. Pavankumar van Son, Rob J. J. H. Magimai-Doss, Mathew https://publications.idiap.ch/index.php/publications/showcite/Dubagunta_Idiap-RR-12-2021 Related documents Computer, Speech & Language 72 0885-2308 2022 Open Access https://doi.org/10.1016/j.csl.2021.101284 doi While public speech resources become increasingly available, there is a growing interest to preserve the privacy of the speakers, through methods that anonymize the speaker information from speech while preserving the spoken linguistic content. In this paper, a method for pseudonymization (reversible anonymization) of speech is presented, that allows to obfuscate the speaker identity in untranscribed running speech. The approach manipulates the spectro-temporal structure of the speech to simulate a different length and structure of the vocal tract by modifying the formant locations, as well as by altering the pitch and speaking rate. The method is deterministic and partially reversible, and the changes are adjustable on a continuous scale. The method has been evaluated in terms of (i) ABX listening experiments, and (ii) automatic speaker verification and speech recognition. ABX experimental results indicate that the speaker identifiability among forced choice pairs reduced from over 90% to less than 70% through pseudonymization, and that de-pseudonymization was partially effective. An evaluation on the VoicePrivacy 2020 challenge data showed that the proposed approach performs better than the signal processing based baseline method that uses McAdams coefficient and performs slightly worse than the neural source filtering based baseline method. Further analysis showed that the proposed approach: (i) is comparable to the neural source filtering baseline based method in terms of phone posterior feature based objective intelligibility measure, (ii) preserves formant tracks better than the McAdams based method, and (iii) preserves paralinguistic aspects such as dysarthria in several speakers. REPORT Dubagunta_Idiap-RR-12-2021/IDIAP Adjustable Deterministic Pseudonymization of Speech Dubagunta, S. Pavankumar Van Son, Rob Magimai-Doss, Mathew EXTERNAL https://publications.idiap.ch/attachments/reports/2021/Dubagunta_Idiap-RR-12-2021.pdf PUBLIC Idiap-RR-12-2021 2021 Idiap August 2021