Summary of the paper

Title Named Entity Tagging a Very Large Unbalanced Corpus: Training and Evaluating NE Classifiers
Authors Joachim Bingel and Thomas Haider
Abstract We describe a systematic and application-oriented approach to training and evaluating named entity recognition and classification (NERC) systems, the purpose of which is to identify an optimal system and to train an optimal model for named entity tagging DeReKo, a very large general-purpose corpus of contemporary German (Kupietz et al., 2010). DeReKo 's strong dispersion wrt. genre, register and time forces us to base our decision for a specific NERC system on an evaluation performed on a representative sample of DeReKo instead of performance figures that have been reported for the individual NERC systems when evaluated on more uniform and less diverse data. We create and manually annotate such a representative sample as evaluation data for three different NERC systems, for each of which various models are learnt on multiple training data. The proposed sampling method can be viewed as a generally applicable method for sampling evaluation data from an unbalanced target corpus for any sort of natural language processing.
Topics Information Extraction, Information Retrieval, Corpus (Creation, Annotation, etc.)
Full paper Named Entity Tagging a Very Large Unbalanced Corpus: Training and Evaluating NE Classifiers
Bibtex @InProceedings{BINGEL14.967,
  author = {Joachim Bingel and Thomas Haider},
  title = {Named Entity Tagging a Very Large Unbalanced Corpus: Training and Evaluating NE Classifiers},
  booktitle = {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)},
  year = {2014},
  month = {may},
  date = {26-31},
  address = {Reykjavik, Iceland},
  editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis},
  publisher = {European Language Resources Association (ELRA)},
  isbn = {978-2-9517408-8-4},
  language = {english}
 }
Powered by ELDA © 2014 ELDA/ELRA