CONF
Parida_SWISSTEXT&KONVENS2020_2020/IDIAP
Idiap Submission to Swiss-German Language Detection Shared Task
Parida, Shantipriya
Villatoro-Tello, Esaú
Kumar, Sajit
Motlicek, Petr
Zhan, Qingran
https://publications.idiap.ch/index.php/publications/showcite/Parida_Idiap-RR-11-2020
Related documents
Proceedings of the 5th Swiss Text Analytics Conference (SwissText) & 16th Conference on Natural Language Processing (KONVENS)
2020
CEUR Workshop Proceedings
1613-0073
http://ceur-ws.org/Vol-2624/germeval-task2-paper4.pdf
URL
Language detection is a key part of the NLP pipeline for text processing. The task of automatically detecting languages belonging to disjoint groups is relatively easy. It is considerably challenging to detect languages that have similar origins or dialects. This paper describes Idiap’s submission to the 2020 Germeval evaluation campaign1on Swiss-German language detection. In this work, we have given high dimensional features generated from the text data as input to a supervised autoencoder for detecting languages with dialect variances. Bayesian optimizer was used to fine-tune the hyper-parameters of the supervised autoencoder. To the best of our knowledge,we are first to apply supervised autoen-coder for the language detection task.
REPORT
Parida_Idiap-RR-11-2020/IDIAP
Idiap Submission to Swiss-German Language Detection Shared Task
Parida, Shantipriya
Villatoro-Tello, Esaú
Kumar, Sajit
Motlicek, Petr
Zhan, Qingran
EXTERNAL
https://publications.idiap.ch/attachments/reports/2020/Parida_Idiap-RR-11-2020.pdf
PUBLIC
Idiap-RR-11-2020
2020
Idiap
June 2020