Summary of the paper
| Title | Lexical Substitution as a Framework for Multiword Evaluation |
|---|---|
| Authors | Diana McCarthy |
| Abstract | In this paper we analyse data from the SemEval lexical substitution task in those cases where the annotators indicated that the target word was part of a phrase before substituting the target with a synonym. We classify the types of phrases that were provided in this way by the annotators in order to evaluate the utility of the method as a means of producing a gold-standard for multiword evaluation. Multiword evaluation is a difficult area because lexical resources are not complete and people’s judgments on multiwords vary. Whilst we do not believe lexical substitution is necessarily a panacea for multiword evaluation, we do believe it is a useful methodology because the annotator is focused on the task of substitution. Following the analysis, we make some recommendations which would make the data easier to classify. |
| Language | Single language |
| Topics | MultiWord Expressions & Collocations, Evaluation methodologies, Lexicon, lexical database |
Full paper |
Lexical Substitution as a Framework for Multiword Evaluation |
Slides |
- |
| Bibtex | @InProceedings{MCCARTHY08.275, author = {Diana McCarthy}, title = {Lexical Substitution as a Framework for Multiword Evaluation}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |