LAOS - Idiap Publications

HyperMixer: An MLP-based Green AI Alternative to Transformers, Florian Mai, Arnaud Pannatier, Fabio Fehr, Haolin Chen, François Marelli, Francois Fleuret and James Henderson, in: arxiv, 2022

ParsiNLU: A Suite of Language Understanding Challenges for Persian, Daniel Khashabi, Arman Cohan, Siamak Shakeri, Pedram Hosseini, Pouya Pezeshkpour, Marzieh Bitaab, Faeze Brahman, Sarik Ghazarian, Arman Kabiri, Rabeeh Karimi Mahabadi, Omid Memarrast, Ahmadreza Mosallanezhad, Erfan Noury, Shahab Raji, Mohammad Sadegh Rasooli, Sepideh Sadeghi, Erfan Sadeqi Azer, Niloofar Safi Samghabadi, Mahsa Shafaei, Saber Sheybani, Ali Tazarv and Yadollah Yaghoobzadeh, in: TACL, 2021

TESS: Text-to-text selfconditioned simplex diffusion, Rabeeh Karimi Mahabadi, Hamish Ivison, Jaesung Tae, James Henderson, Iz Beltagy, Matthew Peters and Arman Cohan, in: Proceedings of the 18th Conference of the European Chapter of the Association for Computational Linguistics (Volume 1: Long Papers), pages 2347–2361, Association for Computational Linguistics, 2024

HyperConformer: Multi-head HyperMixer for Efficient Speech Recognition, Florian Mai, Juan Zuluaga-Gomez, Titouan Parcollet and Petr Motlicek, in: Proc. Interspeech 2023, Ireland, 2023

HyperMixer: An MLP-based Low Cost Alternative to Transformers, Florian Mai, Arnaud Pannatier, Fabio Fehr, Haolin Chen, François Marelli, Francois Fleuret and James Henderson, in: Proc. of the 61st Annual Meeting of the Association for Computational Linguistics, Association for Computational Linguistics, Toronto, Canada, pages 15632-15654, 2023

[DOI]

Transformers as Graph-to-Graph Models, James Henderson, Alireza Mohammadshahi, Andrei Catalin Coman and Lesly Miculicich, in: Big Picture Workshop at EMNLP 2023, 2023

Bag-of-Vectors Autoencoders for Unsupervised Conditional Text Generation, Florian Mai and James Henderson, in: Proceedings of the 2nd Conference of the Asia-Pacific Chapter of the Association for Computational Linguistics and the 12th International Joint Conference on Natural Language Processing (Volume 1: Long Papers), Association for Computational Linguistics, Online, pages 468–488, 2022

[URL]

Graph Refinement for Coreference Resolution, Lesly Miculicich and James Henderson, in: Findings of Association for >Computational Linguistics: ACL 2022, 2022

Compacter: Efficient Low-Rank Hypercomplex Adapter Layers, Rabeeh Karimi Mahabadi, James Henderson and Sebastian Ruder, in: NeurIPS, 2021