Abstract
We are now developing a Japanese speaking test called SCAT, which is part of J-CAT (Japanese Computerized Adaptive Test), a free online proficiency test for Japanese language learners. In this paper, we focus on the sentence-reading-aloud task and the sentence generation task in SCAT, and propose an automatic scoring method for estimating the overall score of answer speech, which is holistically determined by language teachers according to a rating standard. In that process, teachers carefully consider different factors but do not rate the scores of them. We therefore analyze how each factor contributes to the overall score. The factors are divided into two categories: the quality of speech and the content of speech. The former includes pronunciation and intonation, and the latter representation and vocabulary. We then propose an automatic scoring method based on the analysis. Experimental results confirm that the proposed method gives relatively accurate estimates of the overall score.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 2012 International Conference on Speech Database and Assessments, Oriental COCOSDA 2012 |
| Pages | 72-77 |
| Number of pages | 6 |
| DOIs | |
| Publication status | Published - 2012 Dec 1 |
| Externally published | Yes |
| Event | 2012 15th International Conference on Speech Database and Assessments, Oriental COCOSDA 2012 - Macau Duration: 2012 Dec 9 → 2012 Dec 12 |
Other
| Other | 2012 15th International Conference on Speech Database and Assessments, Oriental COCOSDA 2012 |
|---|---|
| City | Macau |
| Period | 12/12/9 → 12/12/12 |
Fingerprint
Keywords
- automatic scoring
- content of speech
- J-CAT
- quality of speech
- SCAT Japanese speaking test
ASJC Scopus subject areas
- Software
- Speech and Hearing
Cite this
Automatic scoring method considering quality and content of speech for scat Japanese speaking test. / Okubo, Naoko; Yamahata, Yuto; Yamada, Takeshi; Imai, Shingo; Ishizuka, Kenkichi; Shinozaki, Takahiro; Nisimura, Ryuichi; Makino, Shoji; Kitawaki, Nobuhiko.
Proceedings of the 2012 International Conference on Speech Database and Assessments, Oriental COCOSDA 2012. 2012. p. 72-77 6422460.Research output: Chapter in Book/Report/Conference proceeding › Conference contribution
}
TY - GEN
T1 - Automatic scoring method considering quality and content of speech for scat Japanese speaking test
AU - Okubo, Naoko
AU - Yamahata, Yuto
AU - Yamada, Takeshi
AU - Imai, Shingo
AU - Ishizuka, Kenkichi
AU - Shinozaki, Takahiro
AU - Nisimura, Ryuichi
AU - Makino, Shoji
AU - Kitawaki, Nobuhiko
PY - 2012/12/1
Y1 - 2012/12/1
N2 - We are now developing a Japanese speaking test called SCAT, which is part of J-CAT (Japanese Computerized Adaptive Test), a free online proficiency test for Japanese language learners. In this paper, we focus on the sentence-reading-aloud task and the sentence generation task in SCAT, and propose an automatic scoring method for estimating the overall score of answer speech, which is holistically determined by language teachers according to a rating standard. In that process, teachers carefully consider different factors but do not rate the scores of them. We therefore analyze how each factor contributes to the overall score. The factors are divided into two categories: the quality of speech and the content of speech. The former includes pronunciation and intonation, and the latter representation and vocabulary. We then propose an automatic scoring method based on the analysis. Experimental results confirm that the proposed method gives relatively accurate estimates of the overall score.
AB - We are now developing a Japanese speaking test called SCAT, which is part of J-CAT (Japanese Computerized Adaptive Test), a free online proficiency test for Japanese language learners. In this paper, we focus on the sentence-reading-aloud task and the sentence generation task in SCAT, and propose an automatic scoring method for estimating the overall score of answer speech, which is holistically determined by language teachers according to a rating standard. In that process, teachers carefully consider different factors but do not rate the scores of them. We therefore analyze how each factor contributes to the overall score. The factors are divided into two categories: the quality of speech and the content of speech. The former includes pronunciation and intonation, and the latter representation and vocabulary. We then propose an automatic scoring method based on the analysis. Experimental results confirm that the proposed method gives relatively accurate estimates of the overall score.
KW - automatic scoring
KW - content of speech
KW - J-CAT
KW - quality of speech
KW - SCAT Japanese speaking test
UR - http://www.scopus.com/inward/record.url?scp=84874256962&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=84874256962&partnerID=8YFLogxK
U2 - 10.1109/ICSDA.2012.6422460
DO - 10.1109/ICSDA.2012.6422460
M3 - Conference contribution
AN - SCOPUS:84874256962
SN - 9781467328104
SP - 72
EP - 77
BT - Proceedings of the 2012 International Conference on Speech Database and Assessments, Oriental COCOSDA 2012
ER -