Analysis of communicative phrase prosody based on linguistic modalities of constituent words

Kazuma Takada, Hideharu Nakajima, Yoshinori Sagisaka

研究成果: Conference contribution

抄録

In this paper, phrase prosody is analyzed based on linguistic modalities of constituent words for communicative speech synthesis. Since Japanese final particles and auxiliaries play crucial roles to indicate speaker's intention and attitudes as modality differences, Japanese phrase sets showing different degree of the speaker's judgment were employed. Communicative/reading speech data were compared over 5 kinds of modality of epistemic judgment (uncertainty of what the speaker said) and 8 kinds of modality of evaluative judgment (what the speaker wishes listeners to be). These modality differences were quantified in 6-point Semantic Differential (SD) scales. The corresponding phrase communicative/reading prosody differences were measured by the F0 rising in the phrase final mora. Statistical analysis showed negative correlation value between F0 rising in the phrase final mora and SD about judgment only in communicative prosody but not in reading prosody. These results support the communicative prosody control possibilities from the modality information embedded in constituent words.

元の言語English
ホスト出版物のタイトル2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings
出版者Institute of Electrical and Electronics Engineers Inc.
ISBN(電子版)9781728101644
DOI
出版物ステータスPublished - 2019 4 16
イベント2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Pattaya, Thailand
継続期間: 2018 11 152018 11 17

出版物シリーズ

名前2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings

Conference

Conference2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018
Thailand
Pattaya
期間18/11/1518/11/17

Fingerprint

Linguistics
Semantics
Semantic Differential
Reading
Speech synthesis
Statistical methods
Uncertainty

Keywords

    ASJC Scopus subject areas

    • Artificial Intelligence
    • Computer Science Applications
    • Computer Vision and Pattern Recognition
    • Software
    • Health Informatics

    これを引用

    Takada, K., Nakajima, H., & Sagisaka, Y. (2019). Analysis of communicative phrase prosody based on linguistic modalities of constituent words. : 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings [8692904] (2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/iSAI-NLP.2018.8692904

    Analysis of communicative phrase prosody based on linguistic modalities of constituent words. / Takada, Kazuma; Nakajima, Hideharu; Sagisaka, Yoshinori.

    2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. 8692904 (2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings).

    研究成果: Conference contribution

    Takada, K, Nakajima, H & Sagisaka, Y 2019, Analysis of communicative phrase prosody based on linguistic modalities of constituent words. : 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings., 8692904, 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings, Institute of Electrical and Electronics Engineers Inc., 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018, Pattaya, Thailand, 18/11/15. https://doi.org/10.1109/iSAI-NLP.2018.8692904
    Takada K, Nakajima H, Sagisaka Y. Analysis of communicative phrase prosody based on linguistic modalities of constituent words. : 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. 8692904. (2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings). https://doi.org/10.1109/iSAI-NLP.2018.8692904
    Takada, Kazuma ; Nakajima, Hideharu ; Sagisaka, Yoshinori. / Analysis of communicative phrase prosody based on linguistic modalities of constituent words. 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. (2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings).
    @inproceedings{ea103125f9b24b98b9251453f72c0aae,
    title = "Analysis of communicative phrase prosody based on linguistic modalities of constituent words",
    abstract = "In this paper, phrase prosody is analyzed based on linguistic modalities of constituent words for communicative speech synthesis. Since Japanese final particles and auxiliaries play crucial roles to indicate speaker's intention and attitudes as modality differences, Japanese phrase sets showing different degree of the speaker's judgment were employed. Communicative/reading speech data were compared over 5 kinds of modality of epistemic judgment (uncertainty of what the speaker said) and 8 kinds of modality of evaluative judgment (what the speaker wishes listeners to be). These modality differences were quantified in 6-point Semantic Differential (SD) scales. The corresponding phrase communicative/reading prosody differences were measured by the F0 rising in the phrase final mora. Statistical analysis showed negative correlation value between F0 rising in the phrase final mora and SD about judgment only in communicative prosody but not in reading prosody. These results support the communicative prosody control possibilities from the modality information embedded in constituent words.",
    keywords = "Communicative speech prosody, Modality, Semantic Differential (SD)",
    author = "Kazuma Takada and Hideharu Nakajima and Yoshinori Sagisaka",
    year = "2019",
    month = "4",
    day = "16",
    doi = "10.1109/iSAI-NLP.2018.8692904",
    language = "English",
    series = "2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",
    booktitle = "2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings",

    }

    TY - GEN

    T1 - Analysis of communicative phrase prosody based on linguistic modalities of constituent words

    AU - Takada, Kazuma

    AU - Nakajima, Hideharu

    AU - Sagisaka, Yoshinori

    PY - 2019/4/16

    Y1 - 2019/4/16

    N2 - In this paper, phrase prosody is analyzed based on linguistic modalities of constituent words for communicative speech synthesis. Since Japanese final particles and auxiliaries play crucial roles to indicate speaker's intention and attitudes as modality differences, Japanese phrase sets showing different degree of the speaker's judgment were employed. Communicative/reading speech data were compared over 5 kinds of modality of epistemic judgment (uncertainty of what the speaker said) and 8 kinds of modality of evaluative judgment (what the speaker wishes listeners to be). These modality differences were quantified in 6-point Semantic Differential (SD) scales. The corresponding phrase communicative/reading prosody differences were measured by the F0 rising in the phrase final mora. Statistical analysis showed negative correlation value between F0 rising in the phrase final mora and SD about judgment only in communicative prosody but not in reading prosody. These results support the communicative prosody control possibilities from the modality information embedded in constituent words.

    AB - In this paper, phrase prosody is analyzed based on linguistic modalities of constituent words for communicative speech synthesis. Since Japanese final particles and auxiliaries play crucial roles to indicate speaker's intention and attitudes as modality differences, Japanese phrase sets showing different degree of the speaker's judgment were employed. Communicative/reading speech data were compared over 5 kinds of modality of epistemic judgment (uncertainty of what the speaker said) and 8 kinds of modality of evaluative judgment (what the speaker wishes listeners to be). These modality differences were quantified in 6-point Semantic Differential (SD) scales. The corresponding phrase communicative/reading prosody differences were measured by the F0 rising in the phrase final mora. Statistical analysis showed negative correlation value between F0 rising in the phrase final mora and SD about judgment only in communicative prosody but not in reading prosody. These results support the communicative prosody control possibilities from the modality information embedded in constituent words.

    KW - Communicative speech prosody

    KW - Modality

    KW - Semantic Differential (SD)

    UR - http://www.scopus.com/inward/record.url?scp=85065058835&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85065058835&partnerID=8YFLogxK

    U2 - 10.1109/iSAI-NLP.2018.8692904

    DO - 10.1109/iSAI-NLP.2018.8692904

    M3 - Conference contribution

    T3 - 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings

    BT - 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -