Abstract
The main goal of the present paper is to propose a new scheme for the overall evaluation of a speech translation system that supports the design of target application systems and determines their performance. Evaluations are conducted on the Japanese-to-English ATR-MATRIX speech translation system, which was developed at ATR Interpreting Telecommunications Research Laboratories. In the proposed scheme, the system is compared with native Japanese taking the Test of English for International Communication (TOEIC) for speech translation capability. A regression analysis using evaluation results shows that the speech translation capability of ATR-MATRIX matches Japanese scoring around 500 on the TOEIC.
| Original language | English |
|---|---|
| Title of host publication | 6th International Conference on Spoken Language Processing, ICSLP 2000 |
| Publisher | International Speech Communication Association |
| ISBN (Electronic) | 7801501144, 9787801501141 |
| Publication status | Published - 2000 |
| Externally published | Yes |
| Event | 6th International Conference on Spoken Language Processing, ICSLP 2000 - Beijing, China Duration: 2000 Oct 16 → 2000 Oct 20 |
Other
| Other | 6th International Conference on Spoken Language Processing, ICSLP 2000 |
|---|---|
| Country | China |
| City | Beijing |
| Period | 00/10/16 → 00/10/20 |
Fingerprint
ASJC Scopus subject areas
- Linguistics and Language
- Language and Linguistics
Cite this
Evaluation of the ATR-MATRIX speech translation system with a pair comparison method between the system and humans. / Sugaya, Fumiaki; Takezawa, Toshiyuki; Yokoo, Akio; Sagisaka, Yoshinori; Yamamoto, Seiichi.
6th International Conference on Spoken Language Processing, ICSLP 2000. International Speech Communication Association, 2000.Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - Evaluation of the ATR-MATRIX speech translation system with a pair comparison method between the system and humans
AU - Sugaya, Fumiaki
AU - Takezawa, Toshiyuki
AU - Yokoo, Akio
AU - Sagisaka, Yoshinori
AU - Yamamoto, Seiichi
PY - 2000
Y1 - 2000
N2 - The main goal of the present paper is to propose a new scheme for the overall evaluation of a speech translation system that supports the design of target application systems and determines their performance. Evaluations are conducted on the Japanese-to-English ATR-MATRIX speech translation system, which was developed at ATR Interpreting Telecommunications Research Laboratories. In the proposed scheme, the system is compared with native Japanese taking the Test of English for International Communication (TOEIC) for speech translation capability. A regression analysis using evaluation results shows that the speech translation capability of ATR-MATRIX matches Japanese scoring around 500 on the TOEIC.
AB - The main goal of the present paper is to propose a new scheme for the overall evaluation of a speech translation system that supports the design of target application systems and determines their performance. Evaluations are conducted on the Japanese-to-English ATR-MATRIX speech translation system, which was developed at ATR Interpreting Telecommunications Research Laboratories. In the proposed scheme, the system is compared with native Japanese taking the Test of English for International Communication (TOEIC) for speech translation capability. A regression analysis using evaluation results shows that the speech translation capability of ATR-MATRIX matches Japanese scoring around 500 on the TOEIC.
UR - http://www.scopus.com/inward/record.url?scp=85009064490&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85009064490&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85009064490
BT - 6th International Conference on Spoken Language Processing, ICSLP 2000
PB - International Speech Communication Association
ER -