Automatic scoring method considering quality and content of speech for scat Japanese speaking test

Naoko Okubo, Yuto Yamahata, Takeshi Yamada, Shingo Imai, Kenkichi Ishizuka, Takahiro Shinozaki, Ryuichi Nisimura, Shoji Makino, Nobuhiko Kitawaki

Research output: Chapter in Book/Report/Conference proceedingConference contribution

1 Citation (Scopus)

Abstract

We are now developing a Japanese speaking test called SCAT, which is part of J-CAT (Japanese Computerized Adaptive Test), a free online proficiency test for Japanese language learners. In this paper, we focus on the sentence-reading-aloud task and the sentence generation task in SCAT, and propose an automatic scoring method for estimating the overall score of answer speech, which is holistically determined by language teachers according to a rating standard. In that process, teachers carefully consider different factors but do not rate the scores of them. We therefore analyze how each factor contributes to the overall score. The factors are divided into two categories: the quality of speech and the content of speech. The former includes pronunciation and intonation, and the latter representation and vocabulary. We then propose an automatic scoring method based on the analysis. Experimental results confirm that the proposed method gives relatively accurate estimates of the overall score.

Original languageEnglish
Title of host publicationProceedings of the 2012 International Conference on Speech Database and Assessments, Oriental COCOSDA 2012
Pages72-77
Number of pages6
DOIs
Publication statusPublished - 2012 Dec 1
Externally publishedYes
Event2012 15th International Conference on Speech Database and Assessments, Oriental COCOSDA 2012 - Macau
Duration: 2012 Dec 92012 Dec 12

Other

Other2012 15th International Conference on Speech Database and Assessments, Oriental COCOSDA 2012
CityMacau
Period12/12/912/12/12

Keywords

  • automatic scoring
  • content of speech
  • J-CAT
  • quality of speech
  • SCAT Japanese speaking test

ASJC Scopus subject areas

  • Software
  • Speech and Hearing

Fingerprint Dive into the research topics of 'Automatic scoring method considering quality and content of speech for scat Japanese speaking test'. Together they form a unique fingerprint.

  • Cite this

    Okubo, N., Yamahata, Y., Yamada, T., Imai, S., Ishizuka, K., Shinozaki, T., Nisimura, R., Makino, S., & Kitawaki, N. (2012). Automatic scoring method considering quality and content of speech for scat Japanese speaking test. In Proceedings of the 2012 International Conference on Speech Database and Assessments, Oriental COCOSDA 2012 (pp. 72-77). [6422460] https://doi.org/10.1109/ICSDA.2012.6422460