Bilingual lexicon induction: Effortless evaluation of word alignment tools and production of resources for improbable language pairs

Adrien Lardilleux, Julien Gosme, Yves Lepage

研究成果: Conference contribution

3 引用 (Scopus)

抜粋

In this paper, we present a simple protocol to evaluate word aligners on bilingual lexicon induction tasks from parallel corpora. Rather than resorting to gold standards, it relies on a comparison of the outputs of word aligners against a reference bilingual lexicon. The quality of this reference bilingual lexicon does not need to be particularly high, because evaluation quality is ensured by systematically filtering this reference lexicon with the parallel corpus the word aligners are trained on. We perform a comparison of three freely available word aligners on numerous language pairs from the Bible parallel corpus (Resnik et al., 1999): MGIZA++ (Gao and Vogel, 2008), BerkeleyAligner (Liang et al., 2006), and Anymalign (Lardilleux and Lepage, 2009). We then select the most appropriate one to produce bilingual lexicons for all language pairs of this corpus. These involve Cebuano, Chinese, Danish, English, Finnish, French, Greek, Indonesian, Latin, Spanish, Swedish, and Vietnamese. The 66 resulting lexicons are made freely available.

元の言語English
ホスト出版物のタイトルProceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010
編集者Daniel Tapias, Irene Russo, Olivier Hamon, Stelios Piperidis, Nicoletta Calzolari, Khalid Choukri, Joseph Mariani, Helene Mazo, Bente Maegaard, Jan Odijk, Mike Rosner
出版者European Language Resources Association (ELRA)
ページ252-256
ページ数5
ISBN(電子版)2951740867, 9782951740860
出版物ステータスPublished - 2010 1 1
イベント7th International Conference on Language Resources and Evaluation, LREC 2010 - Valletta, Malta
継続期間: 2010 5 172010 5 23

出版物シリーズ

名前Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010

Other

Other7th International Conference on Language Resources and Evaluation, LREC 2010
Malta
Valletta
期間10/5/1710/5/23

ASJC Scopus subject areas

  • Education
  • Library and Information Sciences
  • Linguistics and Language
  • Language and Linguistics

フィンガープリント Bilingual lexicon induction: Effortless evaluation of word alignment tools and production of resources for improbable language pairs' の研究トピックを掘り下げます。これらはともに一意のフィンガープリントを構成します。

  • これを引用

    Lardilleux, A., Gosme, J., & Lepage, Y. (2010). Bilingual lexicon induction: Effortless evaluation of word alignment tools and production of resources for improbable language pairs. : D. Tapias, I. Russo, O. Hamon, S. Piperidis, N. Calzolari, K. Choukri, J. Mariani, H. Mazo, B. Maegaard, J. Odijk, & M. Rosner (版), Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010 (pp. 252-256). (Proceedings of the 7th International Conference on Language Resources and Evaluation, LREC 2010). European Language Resources Association (ELRA).