Analysis of communicative phrase prosody based on linguistic modalities of constituent words

Kazuma Takada, Hideharu Nakajima, Yoshinori Sagisaka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

In this paper, phrase prosody is analyzed based on linguistic modalities of constituent words for communicative speech synthesis. Since Japanese final particles and auxiliaries play crucial roles to indicate speaker's intention and attitudes as modality differences, Japanese phrase sets showing different degree of the speaker's judgment were employed. Communicative/reading speech data were compared over 5 kinds of modality of epistemic judgment (uncertainty of what the speaker said) and 8 kinds of modality of evaluative judgment (what the speaker wishes listeners to be). These modality differences were quantified in 6-point Semantic Differential (SD) scales. The corresponding phrase communicative/reading prosody differences were measured by the F0 rising in the phrase final mora. Statistical analysis showed negative correlation value between F0 rising in the phrase final mora and SD about judgment only in communicative prosody but not in reading prosody. These results support the communicative prosody control possibilities from the modality information embedded in constituent words.

Original languageEnglish
Title of host publication2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728101644
DOIs
Publication statusPublished - 2019 Apr 16
Event2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Pattaya, Thailand
Duration: 2018 Nov 152018 Nov 17

Publication series

Name2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings

Conference

Conference2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018
CountryThailand
CityPattaya
Period18/11/1518/11/17

Fingerprint

Linguistics
Semantics
Semantic Differential
Reading
Speech synthesis
Statistical methods
Uncertainty

Keywords

  • Communicative speech prosody
  • Modality
  • Semantic Differential (SD)

ASJC Scopus subject areas

  • Artificial Intelligence
  • Computer Science Applications
  • Computer Vision and Pattern Recognition
  • Software
  • Health Informatics

Cite this

Takada, K., Nakajima, H., & Sagisaka, Y. (2019). Analysis of communicative phrase prosody based on linguistic modalities of constituent words. In 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings [8692904] (2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings). Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/iSAI-NLP.2018.8692904

Analysis of communicative phrase prosody based on linguistic modalities of constituent words. / Takada, Kazuma; Nakajima, Hideharu; Sagisaka, Yoshinori.

2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. 8692904 (2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Takada, K, Nakajima, H & Sagisaka, Y 2019, Analysis of communicative phrase prosody based on linguistic modalities of constituent words. in 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings., 8692904, 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings, Institute of Electrical and Electronics Engineers Inc., 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018, Pattaya, Thailand, 18/11/15. https://doi.org/10.1109/iSAI-NLP.2018.8692904
Takada K, Nakajima H, Sagisaka Y. Analysis of communicative phrase prosody based on linguistic modalities of constituent words. In 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2019. 8692904. (2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings). https://doi.org/10.1109/iSAI-NLP.2018.8692904
Takada, Kazuma ; Nakajima, Hideharu ; Sagisaka, Yoshinori. / Analysis of communicative phrase prosody based on linguistic modalities of constituent words. 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2019. (2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings).
@inproceedings{ea103125f9b24b98b9251453f72c0aae,
title = "Analysis of communicative phrase prosody based on linguistic modalities of constituent words",
abstract = "In this paper, phrase prosody is analyzed based on linguistic modalities of constituent words for communicative speech synthesis. Since Japanese final particles and auxiliaries play crucial roles to indicate speaker's intention and attitudes as modality differences, Japanese phrase sets showing different degree of the speaker's judgment were employed. Communicative/reading speech data were compared over 5 kinds of modality of epistemic judgment (uncertainty of what the speaker said) and 8 kinds of modality of evaluative judgment (what the speaker wishes listeners to be). These modality differences were quantified in 6-point Semantic Differential (SD) scales. The corresponding phrase communicative/reading prosody differences were measured by the F0 rising in the phrase final mora. Statistical analysis showed negative correlation value between F0 rising in the phrase final mora and SD about judgment only in communicative prosody but not in reading prosody. These results support the communicative prosody control possibilities from the modality information embedded in constituent words.",
keywords = "Communicative speech prosody, Modality, Semantic Differential (SD)",
author = "Kazuma Takada and Hideharu Nakajima and Yoshinori Sagisaka",
year = "2019",
month = "4",
day = "16",
doi = "10.1109/iSAI-NLP.2018.8692904",
language = "English",
series = "2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings",
publisher = "Institute of Electrical and Electronics Engineers Inc.",
booktitle = "2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings",

}

TY - GEN

T1 - Analysis of communicative phrase prosody based on linguistic modalities of constituent words

AU - Takada, Kazuma

AU - Nakajima, Hideharu

AU - Sagisaka, Yoshinori

PY - 2019/4/16

Y1 - 2019/4/16

N2 - In this paper, phrase prosody is analyzed based on linguistic modalities of constituent words for communicative speech synthesis. Since Japanese final particles and auxiliaries play crucial roles to indicate speaker's intention and attitudes as modality differences, Japanese phrase sets showing different degree of the speaker's judgment were employed. Communicative/reading speech data were compared over 5 kinds of modality of epistemic judgment (uncertainty of what the speaker said) and 8 kinds of modality of evaluative judgment (what the speaker wishes listeners to be). These modality differences were quantified in 6-point Semantic Differential (SD) scales. The corresponding phrase communicative/reading prosody differences were measured by the F0 rising in the phrase final mora. Statistical analysis showed negative correlation value between F0 rising in the phrase final mora and SD about judgment only in communicative prosody but not in reading prosody. These results support the communicative prosody control possibilities from the modality information embedded in constituent words.

AB - In this paper, phrase prosody is analyzed based on linguistic modalities of constituent words for communicative speech synthesis. Since Japanese final particles and auxiliaries play crucial roles to indicate speaker's intention and attitudes as modality differences, Japanese phrase sets showing different degree of the speaker's judgment were employed. Communicative/reading speech data were compared over 5 kinds of modality of epistemic judgment (uncertainty of what the speaker said) and 8 kinds of modality of evaluative judgment (what the speaker wishes listeners to be). These modality differences were quantified in 6-point Semantic Differential (SD) scales. The corresponding phrase communicative/reading prosody differences were measured by the F0 rising in the phrase final mora. Statistical analysis showed negative correlation value between F0 rising in the phrase final mora and SD about judgment only in communicative prosody but not in reading prosody. These results support the communicative prosody control possibilities from the modality information embedded in constituent words.

KW - Communicative speech prosody

KW - Modality

KW - Semantic Differential (SD)

UR - http://www.scopus.com/inward/record.url?scp=85065058835&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85065058835&partnerID=8YFLogxK

U2 - 10.1109/iSAI-NLP.2018.8692904

DO - 10.1109/iSAI-NLP.2018.8692904

M3 - Conference contribution

T3 - 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings

BT - 2018 International Joint Symposium on Artificial Intelligence and Natural Language Processing, iSAI-NLP 2018 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

ER -