Idiap Submission to Swiss-German Language Detection Shared Task
Type of publication: | Conference paper |
Citation: | Parida_SWISSTEXT&KONVENS2020_2020 |
Publication status: | Published |
Booktitle: | Proceedings of the 5th Swiss Text Analytics Conference (SwissText) & 16th Conference on Natural Language Processing (KONVENS) |
Year: | 2020 |
Month: | June |
Publisher: | CEUR Workshop Proceedings |
ISSN: | 1613-0073 |
Crossref: | Parida_Idiap-RR-11-2020: |
URL: | http://ceur-ws.org/Vol-2624/ge... |
Abstract: | Language detection is a key part of the NLP pipeline for text processing. The task of automatically detecting languages belonging to disjoint groups is relatively easy. It is considerably challenging to detect languages that have similar origins or dialects. This paper describes Idiap’s submission to the 2020 Germeval evaluation campaign1on Swiss-German language detection. In this work, we have given high dimensional features generated from the text data as input to a supervised autoencoder for detecting languages with dialect variances. Bayesian optimizer was used to fine-tune the hyper-parameters of the supervised autoencoder. To the best of our knowledge,we are first to apply supervised autoen-coder for the language detection task. |
Keywords: | |
Projects |
Idiap Innosuisse-SM2 EC H2020-ROXANNE |
Authors | |
Added by: | [UNK] |
Total mark: | 0 |
Attachments
|
|
Notes
|
|
|