LREC 2000 - Papers

LREC 2000 2^nd International Conference on Language Resources & Evaluation

Conference Papers

Papers by paper title: A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Papers by ID number: 1-50, 51-100, 101-150, 151-200, 201-250, 251-300, 301-350, 351-377.

List of all papers and abstracts.

Previous Paper Next Paper

Title Evaluation of Word Alignment Systems

Authors Ahrenberg Lars (Department of Computer and Information Science Linkoping University, Institute of Technology, S-581 83 Linkoping, Sweden, email:lah@ida.liu.se)
Merkel Magnus (Department of Computer and Information Science Linkoping University, Institute of Technology, S-581 83 Linkoping, Sweden, email: magme@ida.liu.se)
Sagvall Hein Anna (Department of Linguistics Uppsala University, Box 527, S-751 20 Uppsala, Sweden, email: anna@ling.uu.se)
Tiedemann Jorg (Department of Linguistics Uppsala University, Box 527, S-751 20 Uppsala, Sweden, email: joerg@stp.ling.uu.se)

Keywords Automatic Evaluation, Bilingual Lexicon Extraction, Evaluation Metrics, Gold Standard, Parallel Text, Word Alignment

Session Session EO3 - Evaluation and Semantics

Abstract Recent years have seen a few serious attempts to develop methods and measures for the evaluation of word alignment systems, notably the Blinker project (Melamed, 1998) and the ARCADE project (Veronis and Langlais, forthcoming). In this paper we discuss different approaches to the problem and report on results from a project where two word alignment systems have been evaluated. These results include methods and tools for the generation of reference data and a set of measures for system performance. We note that the selection and sampling of reference data can have a great impact on scoring results.

ce="Verdana">

Title	Evaluation of Word Alignment Systems
Authors	Ahrenberg Lars (Department of Computer and Information Science Linkoping University, Institute of Technology, S-581 83 Linkoping, Sweden, email:lah@ida.liu.se) Merkel Magnus (Department of Computer and Information Science Linkoping University, Institute of Technology, S-581 83 Linkoping, Sweden, email: magme@ida.liu.se) Sagvall Hein Anna (Department of Linguistics Uppsala University, Box 527, S-751 20 Uppsala, Sweden, email: anna@ling.uu.se) Tiedemann Jorg (Department of Linguistics Uppsala University, Box 527, S-751 20 Uppsala, Sweden, email: joerg@stp.ling.uu.se)
Keywords	Automatic Evaluation, Bilingual Lexicon Extraction, Evaluation Metrics, Gold Standard, Parallel Text, Word Alignment
Session	Session EO3 - Evaluation and Semantics
Abstract	Recent years have seen a few serious attempts to develop methods and measures for the evaluation of word alignment systems, notably the Blinker project (Melamed, 1998) and the ARCADE project (Veronis and Langlais, forthcoming). In this paper we discuss different approaches to the problem and report on results from a project where two word alignment systems have been evaluated. These results include methods and tools for the generation of reference data and a set of measures for system performance. We note that the selection and sampling of reference data can have a great impact on scoring results.