Evaluation of the ATR-MATRIX speech translation system with a pair comparison method between the system and humans

Fumiaki Sugaya; Toshiyuki Takezawa; Akio Yokoo; Yoshinori Sagisaka; Seiichi Yamamoto

Evaluation of the ATR-MATRIX speech translation system with a pair comparison method between the system and humans

Fumiaki Sugaya, Toshiyuki Takezawa, Akio Yokoo, Yoshinori Sagisaka, Seiichi Yamamoto

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

The main goal of the present paper is to propose a new scheme for the overall evaluation of a speech translation system that supports the design of target application systems and determines their performance. Evaluations are conducted on the Japanese-to-English ATR-MATRIX speech translation system, which was developed at ATR Interpreting Telecommunications Research Laboratories. In the proposed scheme, the system is compared with native Japanese taking the Test of English for International Communication (TOEIC) for speech translation capability. A regression analysis using evaluation results shows that the speech translation capability of ATR-MATRIX matches Japanese scoring around 500 on the TOEIC.

Original language	English
Title of host publication	6th International Conference on Spoken Language Processing, ICSLP 2000
Publisher	International Speech Communication Association
ISBN (Electronic)	7801501144, 9787801501141
Publication status	Published - 2000
Externally published	Yes
Event	6th International Conference on Spoken Language Processing, ICSLP 2000 - Beijing, China Duration: 2000 Oct 16 → 2000 Oct 20

Other

Other	6th International Conference on Spoken Language Processing, ICSLP 2000
Country	China
City	Beijing
Period	00/10/16 → 00/10/20

ASJC Scopus subject areas

Linguistics and Language
Language and Linguistics

Fingerprint Dive into the research topics of 'Evaluation of the ATR-MATRIX speech translation system with a pair comparison method between the system and humans'. Together they form a unique fingerprint.

Cite this

Evaluation of the ATR-MATRIX speech translation system with a pair comparison method between the system and humans. / Sugaya, Fumiaki; Takezawa, Toshiyuki; Yokoo, Akio; Sagisaka, Yoshinori; Yamamoto, Seiichi.

6th International Conference on Spoken Language Processing, ICSLP 2000. International Speech Communication Association, 2000.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Sugaya, F, Takezawa, T, Yokoo, A, Sagisaka, Y & Yamamoto, S 2000, Evaluation of the ATR-MATRIX speech translation system with a pair comparison method between the system and humans. in 6th International Conference on Spoken Language Processing, ICSLP 2000. International Speech Communication Association, 6th International Conference on Spoken Language Processing, ICSLP 2000, Beijing, China, 00/10/16.

@inproceedings{7435ffd4a5044914b73577e6b0ba5c3a,

title = "Evaluation of the ATR-MATRIX speech translation system with a pair comparison method between the system and humans",

abstract = "The main goal of the present paper is to propose a new scheme for the overall evaluation of a speech translation system that supports the design of target application systems and determines their performance. Evaluations are conducted on the Japanese-to-English ATR-MATRIX speech translation system, which was developed at ATR Interpreting Telecommunications Research Laboratories. In the proposed scheme, the system is compared with native Japanese taking the Test of English for International Communication (TOEIC) for speech translation capability. A regression analysis using evaluation results shows that the speech translation capability of ATR-MATRIX matches Japanese scoring around 500 on the TOEIC.",

author = "Fumiaki Sugaya and Toshiyuki Takezawa and Akio Yokoo and Yoshinori Sagisaka and Seiichi Yamamoto",

year = "2000",

language = "English",

booktitle = "6th International Conference on Spoken Language Processing, ICSLP 2000",

publisher = "International Speech Communication Association",

note = "6th International Conference on Spoken Language Processing, ICSLP 2000 ; Conference date: 16-10-2000 Through 20-10-2000",

}

TY - GEN

T1 - Evaluation of the ATR-MATRIX speech translation system with a pair comparison method between the system and humans

AU - Sugaya, Fumiaki

AU - Takezawa, Toshiyuki

AU - Yokoo, Akio

AU - Sagisaka, Yoshinori

AU - Yamamoto, Seiichi

PY - 2000

Y1 - 2000

N2 - The main goal of the present paper is to propose a new scheme for the overall evaluation of a speech translation system that supports the design of target application systems and determines their performance. Evaluations are conducted on the Japanese-to-English ATR-MATRIX speech translation system, which was developed at ATR Interpreting Telecommunications Research Laboratories. In the proposed scheme, the system is compared with native Japanese taking the Test of English for International Communication (TOEIC) for speech translation capability. A regression analysis using evaluation results shows that the speech translation capability of ATR-MATRIX matches Japanese scoring around 500 on the TOEIC.

AB - The main goal of the present paper is to propose a new scheme for the overall evaluation of a speech translation system that supports the design of target application systems and determines their performance. Evaluations are conducted on the Japanese-to-English ATR-MATRIX speech translation system, which was developed at ATR Interpreting Telecommunications Research Laboratories. In the proposed scheme, the system is compared with native Japanese taking the Test of English for International Communication (TOEIC) for speech translation capability. A regression analysis using evaluation results shows that the speech translation capability of ATR-MATRIX matches Japanese scoring around 500 on the TOEIC.

UR - http://www.scopus.com/inward/record.url?scp=85009064490&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85009064490&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:85009064490

BT - 6th International Conference on Spoken Language Processing, ICSLP 2000

PB - International Speech Communication Association

T2 - 6th International Conference on Spoken Language Processing, ICSLP 2000

Y2 - 16 October 2000 through 20 October 2000

ER -