Towards a Roadmap for Multimodal Language Resources and Evaluation

An ELSNET workshop at LREC 2002

Las Palmas, Canary Islands, Spain

Sunday, June 2 2002 (14:30 - 20:00)

Aim of the workshop:

The aim of the proposed workshop is to bring together key players in the field of resources and evaluation in order to make a first step towards the creation of a broadly supported Roadmap for Language Resources, i.e. a broadly supported view on the longer, medium and shorter term needs and priorities. This activity should be seen in the context of ELSNET's other roadmapping activities (see, which aim at developing a technological roadmap for the whole field of Human Language Technologies.

The purpose of such roadmaps is to give the R&D community an instrument to identify opportunities for concertation of their activities and better exploitation of possible synergies between players all over the world.

Scope of this workshop:

As there is no standard model for roadmaps for resources and evaluation available, we will narrow the scope of this roadmapping workshop to a specific sub-area: Multimodal Language Resources and Evaluation. This will make our discussions more focused and concrete, and it will also allow us to exploit the fact that this workshop will take place the day after the workshop dedicated to Multimodal Resources and Evaluation of Multimodal Systems (MREMS) in general.

Provisional program:

Start End Action Title Actor(s)
14:30 14:45 Opening Introduction to this workshop Steven Krauwer
14:45 15:15 Interactive Talk Summary of the MREMS Workshop Mark Maybury
15:15 15:40 Talk Challenges and Important Aspects in Planning and Performing Evaluation Studies for Multimodal Dialogue Systems Susanne Höllerer
15:40 16:05 Talk XML and multimodal corpus design: experiences with multi-layered stand-off annotations in the GeM corpus John Bateman, Judy Delin, Renate Herschel
16:05 16:30 Talk Towards a roadmap for Human Language Technologies: Dutch-Flemish experience Diana Binnenpoorte, Catia Cucchiarini, Elisabeth D'Halleweyn, Janienke Sturm and Folkert de Vriend
16:30 17:00 Break
17:00 17:30 Interactive Talk Introduction to the plenary exercises Steven Krauwer
17:30 18:30 Exercise 1 Identifying priorities All
18:30 19:30 Exercise 2 Putting them on a timeline All
19:30 20:00 Discussion Where to go from here All & Steven Krauwer
20:00 Closing

Recommended reading (preferably before the workshop):


The registration fee for the workshop is 90 EURO for conference participants and 140 EURO for others. The fee includes two coffee breaks and the proceedings of the workshop.


Core Programme Committee:

Contact point:

Steven Krauwer, ELSNET coordinator,
UiL-OTS, Trans 10, 3512 JK Utrecht, NL
phone: +31 30 253 6050,
fax: +31 30 253 6000,