Compilation of an idiom example database for supervised idiom identification

Chikara Hashimoto*, Daisuke Kawahara

*この研究の対応する著者

研究成果: Article査読

9 被引用数 (Scopus)

抄録

Some phrases can be interpreted in their context either idiomatically (figuratively) or literally. The precise identification of idioms is essential in order to achieve full-fledged natural language processing. Because of this, the authors of this paper have created an idiom corpus for Japanese. This paper reports on the corpus itself and the results of an idiom identification experiment conducted using the corpus. The corpus targeted 146 ambiguous idioms, and consists of 102,856 examples, each of which is annotated with a literal/idiomatic label. All sentences were collected from the World Wide Web. For idiom identification, 90 out of the 146 idioms were targeted and a word sense disambiguation (WSD) method was adopted using both common WSD features and idiom-specific features. The corpus and the experiment are both, as far as can be determined, the largest of their kinds. It was discovered that a standard supervised WSD method works well for idiom identification and it achieved accuracy levels of 89. 25 and 88. 86%, with and without idiom-specific features, respectively. It was also found that the most effective idiom-specific feature is the one that involves the adjacency of idiom constituents.

本文言語English
ページ(範囲)355-384
ページ数30
ジャーナルLanguage Resources and Evaluation
43
4
DOI
出版ステータスPublished - 2009 12
外部発表はい

ASJC Scopus subject areas

  • 言語および言語学
  • 教育
  • 言語学および言語
  • 図書館情報学

フィンガープリント

「Compilation of an idiom example database for supervised idiom identification」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル