Summary of the paper

Title Temporal Information Annotation: Crowd vs. Experts
Authors Tommaso Caselli, Rachele Sprugnoli and Oana Inel
Abstract This paper describes two sets of crowdsourcing experiments on temporal information annotation conducted on two languages, i.e., English and Italian. The first experiment, launched on the CrowdFlower platform, was aimed at classifying temporal relations given target entities. The second one, relying on the CrowdTruth metric, consisted in two subtasks: one devoted to the recognition of events and temporal expressions and one to the detection and classification of temporal relations. The outcomes of the experiments suggest a valuable use of crowdsourcing annotations also for a complex task like Temporal Processing.
Topics Crowdsourcing, Corpus (Creation, Annotation, etc.), Other
Full paper Temporal Information Annotation: Crowd vs. Experts
Bibtex @InProceedings{CASELLI16.966,
  author = {Tommaso Caselli and Rachele Sprugnoli and Oana Inel},
  title = {Temporal Information Annotation: Crowd vs. Experts},
  booktitle = {Proceedings of the Tenth International Conference on Language Resources and Evaluation (LREC 2016)},
  year = {2016},
  month = {may},
  date = {23-28},
  location = {Portorož, Slovenia},
  editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Sara Goggi and Marko Grobelnik and Bente Maegaard and Joseph Mariani and Helene Mazo and Asuncion Moreno and Jan Odijk and Stelios Piperidis},
  publisher = {European Language Resources Association (ELRA)},
  address = {Paris, France},
  isbn = {978-2-9517408-9-1},
  language = {english}
 }
Powered by ELDA © 2016 ELDA/ELRA