CONF Wester_SSW_2010/IDIAP Speaker adaptation and the evaluation of speaker similarity in the EMIME speech-to-speech translation project Wester, Mirjam Dines, John Gibson, Matthew Liang, Hui Wu, Yi-Jian Saheer, Lakshmi King, Simon Oura, Keiichiro Garner, Philip N. Byrne, William Guan, Yong Hirsimäki, Teemu Karhila, Reima Kurimo, Mikko Shannon, Matt Shiota, Sayaka Tian, Jilei Tokuda, Keiichi Yamagishi, Junichi EXTERNAL http://publications.idiap.ch/attachments/papers/2010/Wester_SSW_2010.pdf PUBLIC Proceedings of the 7th ISCA Speech Synthesis Workshop Kyoto, Japan 2010 September 2010 This paper provides an overview of speaker adaptation research carried out in the EMIME speech-to-speech translation (S2ST) project. We focus on how speaker adaptation transforms can be learned from speech in one language and applied to the acous- tic models of another language. The adaptation is transferred across languages and/or from recognition models to synthesis models. The various approaches investigated can all be viewed as a process in which a mapping is defined in terms of either acoustic model states or linguistic units. The mapping is used to transfer either speech data or adaptation transforms between the two models. Because the success of speaker adaptation in text-to-speech synthesis is measured by judging speaker simi- larity, we also discuss issues concerning evaluation of speaker similarity in an S2ST scenario.