LREC 2000 2nd International Conference on Language Resources & Evaluation

Previous Paper   Next Paper

Title Evaluating Translation Quality as Input to Product Development
Authors Bohan Niamh (Sail Labs GmbH, Balanstr. 57, D-81541 Munchen,
Breidt Elisabeth (Sail Labs GmbH, Balanstr. 57, D-81541 Munchen,
Volk Martin (Department of Computer Science, University of Zürich, Winterthurerstr. 190, CH-8057 Zürich,
Keywords Corpora, Evaluation, Machine Translation, Rating Scales, Translation Quality
Session Session EO1 - Evaluation of Machine Translation
Full Paper, 136.pdf
Abstract In this paper we present a corpus-based method to evaluate the translation quality of machine translation (MT) systems. We start with a shallow analysis of a large corpus and gradually focus the attention on the translation problems. The method constitutes an efficient way to identify the most important grammatical and lexical weaknesses of an MT system and to guide development towards improved translation quality. The evaluation described in the paper was carried out as a cooperation between an MT technology developer, Sail Labs, and the Computational Linguistics group at the University of Zürich.