Summary of the paper

Title Towards Heterogeneous Automatic MT Error Analysis
Authors Jesús Giménez and Lluis Màrquez
Abstract This work studies the viability of performing heterogeneous automatic MT error analyses. Error analysis is, undoubtly, one of the most crucial stages in the development cycle of an MT system. However, often not enough attention is paid to this process. The reason is that performing an accurate error analysis requires intensive human labor. In order to speed up the error analysis process, we suggest partially automatizing it by having automatic evaluation metrics play a more active role. For that purpose, we have compiled a large and heterogeneous set of features at different linguistic levels and at different levels of granularity. Through a practical case study, we show how these features provide an effective means of ellaborating interpretable and detailed automatic reports of translation quality.
Language Single language
Topics Evaluation methodologies, Machine Translation, SpeechToSpeech Translation, Tools, systems, applications
Full paper Towards Heterogeneous Automatic MT Error Analysis
Slides Towards Heterogeneous Automatic MT Error Analysis
Bibtex @InProceedings{GIMEACUTENEZ08.483,
  author = {Jesús Giménez and Lluis Màrquez},
  title = {Towards Heterogeneous Automatic MT Error Analysis},
  booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)},
  year = {2008},
  month = {may},
  date = {28-30},
  address = {Marrakech, Morocco},
  editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias},
  publisher = {European Language Resources Association (ELRA)},
  isbn = {2-9517408-4-0},
  note = {},
  language = {english}

Powered by ELDA © 2008 ELDA/ELRA