LREC 2000 2nd International Conference on Language Resources & Evaluation
 

Previous Paper   Next Paper

Title End-to-End Evaluation of Machine Interpretation Systems: A Graphical Evaluation Tool
Authors Jekat Susanne J. (University of Hamburg, Computer Science Department 1, Vogt-Kölln Str., 30, e-mail: jekat@nats.informatik.uni-hamburg.de)
Tessiore Lorenzo (University of Hamburg, Computer Science Department 1, Vogt-Kölln Str., 30, e-mail: lorenzo@nats.informatik.uni-hamburg.de)
Keywords  
Session Session SP4 - Tools for Evaluation and Processing of Spoken Language Resources
Full Paper 67.ps, 67.pdf
Abstract VERBMOBIL as a long-term project of the Federal Ministry of Education, Science, Research and Technology aims at developing a mobile translation system for spontaneous speech. The source-language input consists of human speech (English, German or Japanese), the translation (bidirectional English-German and Japanese-German) and target-language output is effected by the VERBMOBIL system. As to the innovative character of the project new methods for end-to-end evaluation had to be developed by a subproject which has been established especially for this purpose. In this paper we present criteria for the evaluation of speech-to-speech translation systems and a tool for judging the translation quality which is called Graphical Evaluation Tool (GET)2 .