logo Idiap Research Institute        
 [BibTeX] [Marc21]
Improving Contextual Quality Models for MT Evaluation Based on Evaluators' Feedback
Type of publication: Conference paper
Citation: Estrella_LREC_2008
Booktitle: 6th International Conference on Language Resources and Evaluation
Year: 2008
Location: Marrakech, Morocco
Abstract: The Framework for Machine Translation Evaluation (FEMTI,',','), introduced by the ISLE Evaluation Working Group, contains guidelines for defining a quality model used to evaluate an MT system, in relation to the purpose and context of use of the system. In this paper, we report results from a recent experiment aimed at transferring knowledge from MT evaluation experts into the FEMTI guidelines, in particular, to populate relations denoting the influence of the context of use of a system on its evaluation. The results of this hands-on exercise carried out as part of a tutorial, are publicly available at http://www.issco.unige.ch/femti/.
Projects Idiap
Authors Estrella, Paula
Popescu-Belis, Andrei
King, Margaret
Added by: [UNK]
Total mark: 0