Objective evaluation of english learners' timing control based on a measure reflecting perceptual characteristics

Shizuka Nakamura, Shigeki Matsuda, Hiroaki Kato, Minoru Tsuzaki, Yoshinori Sagisaka

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    8 Citations (Scopus)

    Abstract

    Automatic evaluation of English timing control proficiency is carried out by comparing segmental duration differences between learners and reference native speakers. To obtain an objective measure matched to human subjective evaluation, we introduced a measure reflecting perceptual characteristics. The proposed measure evaluates duration differences weighted by the loudness of the corresponding speech segment and the differences or jumps in loudness from the two adjacent speech segments. Experiments showed that estimated scores using the new perception-based measure provided a correlation coefficient of 0.72 with subjective evaluation scores given by native English speakers on the basis of naturalness in timing control. This correlation turned out to be significantly higher than that of 0.54 obtained when using a simple duration difference measure.

    Original languageEnglish
    Title of host publicationICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings
    Pages4837-4840
    Number of pages4
    DOIs
    Publication statusPublished - 2009
    Event2009 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2009 - Taipei
    Duration: 2009 Apr 192009 Apr 24

    Other

    Other2009 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2009
    CityTaipei
    Period09/4/1909/4/24

    Fingerprint

    Experiments

    Keywords

    • Cognitive science
    • Educational technology
    • Oral communication
    • Psychology

    ASJC Scopus subject areas

    • Signal Processing
    • Software
    • Electrical and Electronic Engineering

    Cite this

    Nakamura, S., Matsuda, S., Kato, H., Tsuzaki, M., & Sagisaka, Y. (2009). Objective evaluation of english learners' timing control based on a measure reflecting perceptual characteristics. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings (pp. 4837-4840). [4960714] https://doi.org/10.1109/ICASSP.2009.4960714

    Objective evaluation of english learners' timing control based on a measure reflecting perceptual characteristics. / Nakamura, Shizuka; Matsuda, Shigeki; Kato, Hiroaki; Tsuzaki, Minoru; Sagisaka, Yoshinori.

    ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2009. p. 4837-4840 4960714.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Nakamura, S, Matsuda, S, Kato, H, Tsuzaki, M & Sagisaka, Y 2009, Objective evaluation of english learners' timing control based on a measure reflecting perceptual characteristics. in ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings., 4960714, pp. 4837-4840, 2009 IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2009, Taipei, 09/4/19. https://doi.org/10.1109/ICASSP.2009.4960714
    Nakamura S, Matsuda S, Kato H, Tsuzaki M, Sagisaka Y. Objective evaluation of english learners' timing control based on a measure reflecting perceptual characteristics. In ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2009. p. 4837-4840. 4960714 https://doi.org/10.1109/ICASSP.2009.4960714
    Nakamura, Shizuka ; Matsuda, Shigeki ; Kato, Hiroaki ; Tsuzaki, Minoru ; Sagisaka, Yoshinori. / Objective evaluation of english learners' timing control based on a measure reflecting perceptual characteristics. ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings. 2009. pp. 4837-4840
    @inproceedings{31c28cb5d7004dd884903b9fc27d907a,
    title = "Objective evaluation of english learners' timing control based on a measure reflecting perceptual characteristics",
    abstract = "Automatic evaluation of English timing control proficiency is carried out by comparing segmental duration differences between learners and reference native speakers. To obtain an objective measure matched to human subjective evaluation, we introduced a measure reflecting perceptual characteristics. The proposed measure evaluates duration differences weighted by the loudness of the corresponding speech segment and the differences or jumps in loudness from the two adjacent speech segments. Experiments showed that estimated scores using the new perception-based measure provided a correlation coefficient of 0.72 with subjective evaluation scores given by native English speakers on the basis of naturalness in timing control. This correlation turned out to be significantly higher than that of 0.54 obtained when using a simple duration difference measure.",
    keywords = "Cognitive science, Educational technology, Oral communication, Psychology",
    author = "Shizuka Nakamura and Shigeki Matsuda and Hiroaki Kato and Minoru Tsuzaki and Yoshinori Sagisaka",
    year = "2009",
    doi = "10.1109/ICASSP.2009.4960714",
    language = "English",
    isbn = "9781424423545",
    pages = "4837--4840",
    booktitle = "ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings",

    }

    TY - GEN

    T1 - Objective evaluation of english learners' timing control based on a measure reflecting perceptual characteristics

    AU - Nakamura, Shizuka

    AU - Matsuda, Shigeki

    AU - Kato, Hiroaki

    AU - Tsuzaki, Minoru

    AU - Sagisaka, Yoshinori

    PY - 2009

    Y1 - 2009

    N2 - Automatic evaluation of English timing control proficiency is carried out by comparing segmental duration differences between learners and reference native speakers. To obtain an objective measure matched to human subjective evaluation, we introduced a measure reflecting perceptual characteristics. The proposed measure evaluates duration differences weighted by the loudness of the corresponding speech segment and the differences or jumps in loudness from the two adjacent speech segments. Experiments showed that estimated scores using the new perception-based measure provided a correlation coefficient of 0.72 with subjective evaluation scores given by native English speakers on the basis of naturalness in timing control. This correlation turned out to be significantly higher than that of 0.54 obtained when using a simple duration difference measure.

    AB - Automatic evaluation of English timing control proficiency is carried out by comparing segmental duration differences between learners and reference native speakers. To obtain an objective measure matched to human subjective evaluation, we introduced a measure reflecting perceptual characteristics. The proposed measure evaluates duration differences weighted by the loudness of the corresponding speech segment and the differences or jumps in loudness from the two adjacent speech segments. Experiments showed that estimated scores using the new perception-based measure provided a correlation coefficient of 0.72 with subjective evaluation scores given by native English speakers on the basis of naturalness in timing control. This correlation turned out to be significantly higher than that of 0.54 obtained when using a simple duration difference measure.

    KW - Cognitive science

    KW - Educational technology

    KW - Oral communication

    KW - Psychology

    UR - http://www.scopus.com/inward/record.url?scp=70349217248&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=70349217248&partnerID=8YFLogxK

    U2 - 10.1109/ICASSP.2009.4960714

    DO - 10.1109/ICASSP.2009.4960714

    M3 - Conference contribution

    AN - SCOPUS:70349217248

    SN - 9781424423545

    SP - 4837

    EP - 4840

    BT - ICASSP, IEEE International Conference on Acoustics, Speech and Signal Processing - Proceedings

    ER -