Summary of the paper

Title Overview of Todai Robot Project and Evaluation Framework of its NLP-based Problem Solving
Authors Akira Fujita, Akihiro Kameda, Ai Kawazoe and Yusuke Miyao
Abstract We introduce the organization of the Todai Robot Project and discuss its achievements. The Todai Robot Project task focuses on benchmarking NLP systems for problem solving. This task encourages NLP-based systems to solve real high-school examinations. We describe the details of the method to manage question resources and their correct answers, answering tools and participation by researchers in the task. We also analyse the answering accuracy of the developed systems by comparing the systems’ answers with answers given by human test-takers.
Topics Question Answering, Evaluation Methodologies
Full paper Overview of Todai Robot Project and Evaluation Framework of its NLP-based Problem Solving
Bibtex @InProceedings{FUJITA14.74,
  author = {Akira Fujita and Akihiro Kameda and Ai Kawazoe and Yusuke Miyao},
  title = {Overview of Todai Robot Project and Evaluation Framework of its NLP-based Problem Solving},
  booktitle = {Proceedings of the Ninth International Conference on Language Resources and Evaluation (LREC'14)},
  year = {2014},
  month = {may},
  date = {26-31},
  address = {Reykjavik, Iceland},
  editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Thierry Declerck and Hrafn Loftsson and Bente Maegaard and Joseph Mariani and Asuncion Moreno and Jan Odijk and Stelios Piperidis},
  publisher = {European Language Resources Association (ELRA)},
  isbn = {978-2-9517408-8-4},
  language = {english}
 }
Powered by ELDA © 2014 ELDA/ELRA