Incremental methods to select test sentences for evaluating translation ability

Yasuhiro Akiba, Eiichiro Sumita, Hiromi Nakaiwa, Seiichi Yamamoto, Hiroshi G. Okuno

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

This paper addresses the problem of selecting test sentences for automatically evaluating language learners' translation ability within a smaller error. In this paper, the ability to translate is measured as a TOEIC score. The existing selection methods only check whether an individual test sentence contributes to the estimation of the ability to translate or that of more general academic abilities, although combinations of test sentences may be used to contribute the estimation. This paper proposes two methods that solve the selection problem. The first method selects test sentences to minimize the estimation errors of learners' TOEIC scores. The second method selects test sentences to maximize the correlation coefficient between the number of correct translations and learners' estimated TOEIC scores. The optimization technique used in both of the proposed methods is the gradient technique in mathematical programming. The proposed methods proved to be more accurate than any of the existing methods we tested, and they estimated each TOEIC score within a permissible error of 69 points.

Original languageEnglish
Title of host publicationProceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004
PublisherEuropean Language Resources Association (ELRA)
Pages2015-2018
Number of pages4
ISBN (Electronic)2951740816, 9782951740815
Publication statusPublished - 2004 Jan 1
Externally publishedYes
Event4th International Conference on Language Resources and Evaluation, LREC 2004 - Lisbon, Portugal
Duration: 2004 May 262004 May 28

Other

Other4th International Conference on Language Resources and Evaluation, LREC 2004
CountryPortugal
CityLisbon
Period04/5/2604/5/28

ASJC Scopus subject areas

  • Library and Information Sciences
  • Education
  • Language and Linguistics
  • Linguistics and Language

Fingerprint Dive into the research topics of 'Incremental methods to select test sentences for evaluating translation ability'. Together they form a unique fingerprint.

  • Cite this

    Akiba, Y., Sumita, E., Nakaiwa, H., Yamamoto, S., & Okuno, H. G. (2004). Incremental methods to select test sentences for evaluating translation ability. In Proceedings of the 4th International Conference on Language Resources and Evaluation, LREC 2004 (pp. 2015-2018). European Language Resources Association (ELRA).