LREC 2000 - Papers

LREC 2000 2^nd International Conference on Language Resources & Evaluation

Conference Papers

Papers by paper title: A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Papers by ID number: 1-50, 51-100, 101-150, 151-200, 201-250, 251-300, 301-350, 351-377.

List of all papers and abstracts.

Previous Paper Next Paper

Title Inter-annotator Agreement for a German Newspaper Corpus

Authors Brants Thorsten (Computational Linguistics, Saarland University, 66041 Saarbrucken, Germany, brants@coli.uni-sb.de)

Keywords Corpus Annotation, Evaluation, Inter-Annotator Agreement

Session Session WO18 - Morphology in Lexical and Textual Resources

Abstract This paper presents the results of an investigation on inter-annotator agreement for the NEGRA corpus, consisting of German newspaper texts. The corpus is syntactically annotated with part-of-speech and structural information. Agreement for part-of-speech is 98.6%, the labeled F-score for structures is 92.4%. The two annotations are used to create a common final version by discussing differences and by several iterations of cleaning. Initial and final versions are compared. We identify categories causing large numbers of differences and categories that are handled inconsistently.

Title	Inter-annotator Agreement for a German Newspaper Corpus
Authors	Brants Thorsten (Computational Linguistics, Saarland University, 66041 Saarbrucken, Germany, brants@coli.uni-sb.de)
Keywords	Corpus Annotation, Evaluation, Inter-Annotator Agreement
Session	Session WO18 - Morphology in Lexical and Textual Resources
Abstract	This paper presents the results of an investigation on inter-annotator agreement for the NEGRA corpus, consisting of German newspaper texts. The corpus is syntactically annotated with part-of-speech and structural information. Agreement for part-of-speech is 98.6%, the labeled F-score for structures is 92.4%. The two annotations are used to create a common final version by discussing differences and by several iterations of cleaning. Initial and final versions are compared. We identify categories causing large numbers of differences and categories that are handled inconsistently.