Annotations for Dynamic Diagnosis of the Dialog State


Laurence Devillers (LIMSI-CNRS, BP 133 91403 Orsay cedex, France)

Sophie Rosset (LIMSI-CNRS, BP 133 91403 Orsay cedex, France)

Helene Bonneau-Maynard (LIMSI-CNRS, BP 133 91403 Orsay cedex, France)

Lori Lamel (LIMSI-CNRS, BP 133 91403 Orsay cedex, France)


SP3 Annotation Tools: From Speech Segments To Dialogues


This paper describes recent work aimed at relating multi-level dialog annotations with meta-data annotations for a corpus of real humanhuman dialogs. This work is carried out in the context of the AMITIES project in which spoken dialog systems for call center services are being developed. A corpus of 100 agent-client dialogs have been annotated with three types of annotations. The first are utterance-level DAMSL-style dialogic labels. The second set of annotations applies to exchanges and takes into account of the dynamic aspect of dialog progress. Finally, 5 emotions types are annotated at the utterance level. Some of these multi-style annotations were used in a multiple linear regression analysis to predict dialog quality. The predictive factors are able to explain about 80% of the dialog accidents.


Dialog state

Full Paper