Evaluation of the ATR-MATRIX speech translation system with a pair comparison method between the system and humans

Fumiaki Sugaya, Toshiyuki Takezawa, Akio Yokoo, Yoshinori Sagisaka, Seiichi Yamamoto

Research output: Chapter in Book/Report/Conference proceedingConference contribution

14 Citations (Scopus)

Abstract

The main goal of the present paper is to propose a new scheme for the overall evaluation of a speech translation system that supports the design of target application systems and determines their performance. Evaluations are conducted on the Japanese-to-English ATR-MATRIX speech translation system, which was developed at ATR Interpreting Telecommunications Research Laboratories. In the proposed scheme, the system is compared with native Japanese taking the Test of English for International Communication (TOEIC) for speech translation capability. A regression analysis using evaluation results shows that the speech translation capability of ATR-MATRIX matches Japanese scoring around 500 on the TOEIC.

Original languageEnglish
Title of host publication6th International Conference on Spoken Language Processing, ICSLP 2000
PublisherInternational Speech Communication Association
ISBN (Electronic)7801501144, 9787801501141
Publication statusPublished - 2000
Externally publishedYes
Event6th International Conference on Spoken Language Processing, ICSLP 2000 - Beijing, China
Duration: 2000 Oct 162000 Oct 20

Other

Other6th International Conference on Spoken Language Processing, ICSLP 2000
CountryChina
CityBeijing
Period00/10/1600/10/20

ASJC Scopus subject areas

  • Linguistics and Language
  • Language and Linguistics

Fingerprint Dive into the research topics of 'Evaluation of the ATR-MATRIX speech translation system with a pair comparison method between the system and humans'. Together they form a unique fingerprint.

  • Cite this

    Sugaya, F., Takezawa, T., Yokoo, A., Sagisaka, Y., & Yamamoto, S. (2000). Evaluation of the ATR-MATRIX speech translation system with a pair comparison method between the system and humans. In 6th International Conference on Spoken Language Processing, ICSLP 2000 International Speech Communication Association.