Summary of the paper
| Title | Detection of Peculiar Examples using LOF and One Class SVM |
|---|---|
| Authors | Hiroyuki Shinnou and Minoru Sasaki |
| Abstract | This paper proposes the method to detect peculiar examples of the target word from a corpus. In this paper we regard following examples as peculiar examples: (1) a meaning of the target word in the example is new, (2) a compound word consisting of the target word in the example is new or very technical. The peculiar example is regarded as an outlier in the given example set. Therefore we can apply many methods proposed in the data mining domain to our task. In this paper, we propose the method to combine the density based method, Local Outlier Factor (LOF), and One Class SVM, which are representative outlier detection methods in the data mining domain. In the experiment, we use the Whitepaper text in BCCWJ as the corpus, and 10 noun words as target words. Our method improved precision and recall of LOF and One Class SVM. And we show that our method can detect new meanings by using the noun `midori (green)'. The main reason of un-detections and wrong detection is that similarity measure of two examples is inadequacy. In future, we must improve it. |
| Topics | Text mining, Word Sense Disambiguation, Lexicon, lexical database |
Full paper |
Detection of Peculiar Examples using LOF and One Class SVM |
Slides |
- |
| Bibtex | @InProceedings{SHINNOU10.167, author = {Hiroyuki Shinnou and Minoru Sasaki}, title = {Detection of Peculiar Examples using LOF and One Class SVM}, booktitle = {Proceedings of the Seventh International Conference on Language Resources and Evaluation (LREC'10)}, year = {2010}, month = {may}, date = {19-21}, address = {Valletta, Malta}, editor = {Nicoletta Calzolari (Conference Chair) and Khalid Choukri and Bente Maegaard and Joseph Mariani and Jan Odijk and Stelios Piperidis and Mike Rosner and Daniel Tapias}, publisher = {European Language Resources Association (ELRA)}, isbn = {2-9517408-6-7}, language = {english} } |