How Comparable are Parallel Corpora? Measuring the Distribution of General Vocabulary and Connectives
Type of publication: | Conference paper |
Citation: | Cartoni_BUCC_2011 |
Publication status: | Published |
Booktitle: | Proceedings of 4th Workshop on Building and Using Comparable Corpora |
Year: | 2011 |
Month: | June |
Pages: | 78--86 |
Location: | Portland, OR |
Organization: | ACL |
Abstract: | In this paper, we question the homogeneity of a large parallel corpus by measuring the similarity between various sub-parts. We compare results obtained using a general measure of lexical similarity based on c2 and by counting the number of discourse connectives. We argue that discourse connectives provide a more sensitive measure, revealing differences that are not visible with the general measure. We also provide evidence for the existence of specific characteristics defining translated texts as opposed to nontranslated ones, due to a universal tendency for explicitation. |
Keywords: | Comparable Corpora, Corpora, discourse connectives, Homogeneity, Measures, Parallel Corpora, Similarity |
Projects |
Idiap COMTIS |
Authors | |
Added by: | [UNK] |
Total mark: | 0 |
Attachments
|
|
Notes
|
|
|