Motivation and Aims

The aim of the proposed workshop is to bring together key players in the field of resources and evaluation in order to make a first step towards the creation of a broadly supported Roadmap for Language Resources, i.e. a broadly supported view on the longer, medium and shorter term needs and priorities. This activity should be seen in the context of ELSNET's other roadmapping activities, which aim at developing a technological roadmap for the whole field of Human Language Technologies.

The purpose of such roadmaps is to give the R&D community an instrument to identify opportunities for concertation of their activities and better exploitation of possible synergies between players all over the world.

Scope of this workshop:

As there is no standard model for roadmaps for resources and evaluation available, we will narrow the scope of this roadmapping workshop to a specific sub-area: Multimodal Language Resources and Evaluation. This will make our discussions more focused and concrete, and it will also allow us to exploit the fact that this workshop will take place the day after the workshop dedicated to Multimodal Resources and Evaluation of Multimodal Systems (MREMS) in general.

Topics of Interest

Submissions are invited on the following topics:

• Summary of roadmap-relevant issues discussed at the MREMS workshop the day before (e.g. challenges);
• Identification of key issues, their interdependencies, priorities, strategies, infrastructures;
• Discussion of appropriate models for the creation and presentation of roadmaps (e.g. extrapolation, Delphi methods, timelines, scenarios, consensus creation);
• Creation of a first preliminary roadmap for multimodal resources and evaluation;
• Definition of further steps.

Workshop Agenda

It will be a full-day workshop, with a morning session from 8:30 to 13:00 and an afternoon session from 14:30 to 19:00. The workshop is not intended to be a mini-conference, but as a real workshop aiming at a concrete result that should pave the way for further development of the resources roadmap. Sessions may include invited talks, a small number of refereed presentations, panel sessions, small working groups addressing specific questions.

Intended Input:

For this workshop we need forward-looking (position) papers that aim at identifying or interconnecting key issues and resources, major challenges, and strategies to reach our goals, as well as papers addressing meta issues (i.e. what is a roadmap, how to reach consensus, etc).

Intended Output:

A draft roadmap report that can be published on the web in order to elicit feedback, and in order to serve as an example for the creation of roadmaps for other subareas.

Submissions

Submissions must be in English, no more than 4 pages long and in single column format. Submissions should be sent electronically in plain text, MS Word or PDF to steven.krauwer@elsnet.org

Important Dates

Registration Fees

• If you are not attending LREC: 140 EURO
• If you are attending LREC: 90 Euro

The fees include two coffee breaks and the proceedings of the workshop.

Core Programme Committee

Contact point