|LREC 2000 2nd International Conference on Language Resources & Evaluation
Previous Paper Next Paper
|End-to-End Evaluation of Machine Interpretation Systems: A Graphical Evaluation Tool
|Jekat Susanne J. (University of Hamburg, Computer Science Department 1, Vogt-Kölln Str., 30, e-mail: firstname.lastname@example.org)
Tessiore Lorenzo (University of Hamburg, Computer Science Department 1, Vogt-Kölln Str., 30, e-mail: email@example.com)
|Session SP4 - Tools for Evaluation and Processing of Spoken Language Resources
|VERBMOBIL as a long-term project of the Federal Ministry of Education, Science, Research and Technology aims at developing a mobile translation system for spontaneous speech. The source-language input consists of human speech (English, German or Japanese), the translation (bidirectional English-German and Japanese-German) and target-language output is effected by the VERBMOBIL system. As to the innovative character of the project new methods for end-to-end evaluation had to be developed by a subproject which has been established especially for this purpose. In this paper we present criteria for the evaluation of speech-to-speech translation systems and a tool for judging the translation quality which is called Graphical Evaluation Tool (GET)2 .