logo Idiap Research Institute        
 [BibTeX] [Marc21]
Idiap Submission to Swiss-German Language Detection Shared Task
Type of publication: Conference paper
Citation: Parida_SWISSTEXT&KONVENS2020_2020
Publication status: Published
Booktitle: Proceedings of the 5th Swiss Text Analytics Conference (SwissText) & 16th Conference on Natural Language Processing (KONVENS)
Year: 2020
Month: June
Publisher: CEUR Workshop Proceedings
ISSN: 1613-0073
Crossref: Parida_Idiap-RR-11-2020:
URL: http://ceur-ws.org/Vol-2624/ge...
Abstract: Language detection is a key part of the NLP pipeline for text processing. The task of automatically detecting languages belonging to disjoint groups is relatively easy. It is considerably challenging to detect languages that have similar origins or dialects. This paper describes Idiap’s submission to the 2020 Germeval evaluation campaign1on Swiss-German language detection. In this work, we have given high dimensional features generated from the text data as input to a supervised autoencoder for detecting languages with dialect variances. Bayesian optimizer was used to fine-tune the hyper-parameters of the supervised autoencoder. To the best of our knowledge,we are first to apply supervised autoen-coder for the language detection task.
Keywords:
Projects Idiap
Innosuisse-SM2
EC H2020-ROXANNE
Authors Parida, Shantipriya
VILLATORO-TELLO, Esaú
Kumar, Sajit
Motlicek, Petr
Zhan, Qingran
Added by: [UNK]
Total mark: 0
Attachments
    Notes