Summary of the paper
| Title | A Comparative Study on Language Identification Methods |
|---|---|
| Authors | Lena Grothe, Ernesto William De Luca and Andreas Nürnberger |
| Abstract | In this paper we present two experiments conducted for comparison of different language identification algorithms. Short words-, frequent words- and n-gram-based approaches are considered and combined with the Ad-Hoc Ranking classification method. The language identification process can be subdivided into two main steps: first a document model is generated for the document and a language model for the language; second the language of the document is determined on the basis of the language model and is added to the document as additional information. In this work we present our evaluation results and discuss the importance of a dynamic value for the out-of-place measure. |
| Language | |
| Topics | Document Classification, Text categorisation, Language modelling, Multilinguality |
Full paper |
A Comparative Study on Language Identification Methods |
Slides |
A Comparative Study on Language Identification Methods |
| Bibtex | @InProceedings{GROTHE08.249, author = {Lena Grothe, Ernesto William De Luca and Andreas Nürnberger}, title = {A Comparative Study on Language Identification Methods}, booktitle = {Proceedings of the Sixth International Conference on Language Resources and Evaluation (LREC'08)}, year = {2008}, month = {may}, date = {28-30}, address = {Marrakech, Morocco}, editor = {Nicoletta Calzolari (Conference Chair), Khalid Choukri, Bente Maegaard, Joseph Mariani, Jan Odijk, Stelios Piperidis, Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-4-0}, note = {http://www.lrec-conf.org/proceedings/lrec2008/}, language = {english} } |