The Future of Evaluation for Cross-Language Information Retrieval Systems


Carol Peters (1), Martin Braschler (2), Khalid Choukri (3), Julio Gonzalo (4), Michael Kluck (5)

(1) ISTI-CNR, Area di Ricerca CNR, 56124 Pisa, Italy, carol.peters@isti.cnr.it; (2) Eurospider Information Technology AG, Zurich, Switzerland, martin.braschler@eurospider.com; (3) Evaluations and Language resources Distribution Agency, Paris, France, choukri@elda.fr; (4) Lenguajes y Sistemas Informáticos, Universidad Nacional de Educaciòn a Distancia, Madrid, Spain, julio@lsi.uned.es; (5) Informationszentrum Sozialwissenschaften (IZ), 53113 Bonn, Germany, kluck@bonn.iz-soz.de




The objective of the Cross-Language Evaluation Forum (CLEF) is to promote research in the multilingual information access domain. In this short paper, we list the achievements of CLEF during its first four years of activity and describe how the range of tasks has been considerably expanded during this period. The aim of the paper is to demonstrate the importance of evaluation initiatives with respect to system research and development and to show how essential it is for such initiatives to keep abreast of and even anticipate the emerging needs of both system developers and application communities if they are to have a future.


Multilingual Information Access, Cross-language Information Retrieval, Information Retrieval System Evaluation



Full Paper