Construction of an idiom corpus and its application to idiom identification based on WSD incorporating idiom-specific features

Chikara Hashimoto, Daisuke Kawahara

Research output: Contribution to conferencePaper

15 Citations (Scopus)

Abstract

Some phrases can be interpreted either idiomatically (figuratively) or literally in context, and the precise identification of idioms is indispensable for full-fledged natural language processing (NLP). To this end, we have constructed an idiom corpus for Japanese. This paper reports on the corpus and the results of an idiom identification experiment using the corpus. The corpus targets 146 ambiguous idioms, and consists of 102,846 sentences, each of which is annotated with a literal/idiom label. For idiom identification, we targeted 90 out of the 146 idioms and adopted a word sense disambiguation (WSD) method using both common WSD features and idiom-specific features. The corpus and the experiment are the largest of their kind, as far as we know. As a result, we found that a standard supervised WSD method works well for the idiom identification and achieved an accuracy of 89.25% and 88.86% with/without idiom-specific features and that the most effective idiom-specific feature is the one involving the adjacency of idiom constituents.

Original languageEnglish
Pages992-1001
Number of pages10
DOIs
Publication statusPublished - 2008
Externally publishedYes
Event2008 Conference on Empirical Methods in Natural Language Processing, EMNLP 2008, Co-located with AMTA 2008 and the International Workshop on Spoken Language Translation - Honolulu, HI, United States
Duration: 2008 Oct 252008 Oct 27

Conference

Conference2008 Conference on Empirical Methods in Natural Language Processing, EMNLP 2008, Co-located with AMTA 2008 and the International Workshop on Spoken Language Translation
CountryUnited States
CityHonolulu, HI
Period08/10/2508/10/27

ASJC Scopus subject areas

  • Information Systems
  • Computational Theory and Mathematics
  • Computer Science Applications

Fingerprint Dive into the research topics of 'Construction of an idiom corpus and its application to idiom identification based on WSD incorporating idiom-specific features'. Together they form a unique fingerprint.

  • Cite this

    Hashimoto, C., & Kawahara, D. (2008). Construction of an idiom corpus and its application to idiom identification based on WSD incorporating idiom-specific features. 992-1001. Paper presented at 2008 Conference on Empirical Methods in Natural Language Processing, EMNLP 2008, Co-located with AMTA 2008 and the International Workshop on Spoken Language Translation, Honolulu, HI, United States. https://doi.org/10.3115/1613715.1613844