Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression

Kanako Watanabe; Yoko Greenberg; Yoshinori Sagisaka

doi:10.1109/APSIPA.2014.7041586

Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression

Kanako Watanabe, Yoko Greenberg, Yoshinori Sagisaka

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

4 Citations (Scopus)

Abstract

In this paper, the sentiment correlation between color and speech has been investigated aiming at multimodal expression of information embedded in speech. To cope with the necessity of information specification for further analyses and control of speech so called para-linguistic information, we carried out an sentiment experiment on the correlations between speech characteristics and color attributes associated by perceptual impressions. Using five vowel categories with twelve different prosodie patterns, we found high correlations between speech features (vowel categories and FO) and three attributes of color (hue, saturation and value). These correlations open up wide possibilities to describe and quantitatively analyze speech information that has not yet been systematically studied but partially treated as emotional variants or para-linguistic information.

Original language	English
Title of host publication	2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014
Publisher	Institute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)	9786163618238
DOIs	https://doi.org/10.1109/APSIPA.2014.7041586
Publication status	Published - 2014 Feb 12
Event	2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014 - Chiang Mai, Thailand Duration: 2014 Dec 9 → 2014 Dec 12

Other

Other	2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014
Country/Territory	Thailand
City	Chiang Mai
Period	14/12/9 → 14/12/12

ASJC Scopus subject areas

Signal Processing
Information Systems

Access to Document

10.1109/APSIPA.2014.7041586

Cite this

Watanabe, K., Greenberg, Y., & Sagisaka, Y. (2014). Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression. In 2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014 [7041586] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/APSIPA.2014.7041586

Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression. / Watanabe, Kanako; Greenberg, Yoko; Sagisaka, Yoshinori.

2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014. Institute of Electrical and Electronics Engineers Inc., 2014. 7041586.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Watanabe, K, Greenberg, Y & Sagisaka, Y 2014, Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression. in 2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014., 7041586, Institute of Electrical and Electronics Engineers Inc., 2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014, Chiang Mai, Thailand, 14/12/9. https://doi.org/10.1109/APSIPA.2014.7041586

@inproceedings{36f94866a78f44408ce45857a39d6c23,

title = "Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression",

abstract = "In this paper, the sentiment correlation between color and speech has been investigated aiming at multimodal expression of information embedded in speech. To cope with the necessity of information specification for further analyses and control of speech so called para-linguistic information, we carried out an sentiment experiment on the correlations between speech characteristics and color attributes associated by perceptual impressions. Using five vowel categories with twelve different prosodie patterns, we found high correlations between speech features (vowel categories and FO) and three attributes of color (hue, saturation and value). These correlations open up wide possibilities to describe and quantitatively analyze speech information that has not yet been systematically studied but partially treated as emotional variants or para-linguistic information.",

author = "Kanako Watanabe and Yoko Greenberg and Yoshinori Sagisaka",

year = "2014",

month = feb,

day = "12",

doi = "10.1109/APSIPA.2014.7041586",

language = "English",

booktitle = "2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

address = "United States",

note = "2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014 ; Conference date: 09-12-2014 Through 12-12-2014",

}

TY - GEN

T1 - Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression

AU - Watanabe, Kanako

AU - Greenberg, Yoko

AU - Sagisaka, Yoshinori

PY - 2014/2/12

Y1 - 2014/2/12

N2 - In this paper, the sentiment correlation between color and speech has been investigated aiming at multimodal expression of information embedded in speech. To cope with the necessity of information specification for further analyses and control of speech so called para-linguistic information, we carried out an sentiment experiment on the correlations between speech characteristics and color attributes associated by perceptual impressions. Using five vowel categories with twelve different prosodie patterns, we found high correlations between speech features (vowel categories and FO) and three attributes of color (hue, saturation and value). These correlations open up wide possibilities to describe and quantitatively analyze speech information that has not yet been systematically studied but partially treated as emotional variants or para-linguistic information.

AB - In this paper, the sentiment correlation between color and speech has been investigated aiming at multimodal expression of information embedded in speech. To cope with the necessity of information specification for further analyses and control of speech so called para-linguistic information, we carried out an sentiment experiment on the correlations between speech characteristics and color attributes associated by perceptual impressions. Using five vowel categories with twelve different prosodie patterns, we found high correlations between speech features (vowel categories and FO) and three attributes of color (hue, saturation and value). These correlations open up wide possibilities to describe and quantitatively analyze speech information that has not yet been systematically studied but partially treated as emotional variants or para-linguistic information.

UR - http://www.scopus.com/inward/record.url?scp=84983108538&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84983108538&partnerID=8YFLogxK

U2 - 10.1109/APSIPA.2014.7041586

DO - 10.1109/APSIPA.2014.7041586

M3 - Conference contribution

AN - SCOPUS:84983108538

BT - 2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014

Y2 - 9 December 2014 through 12 December 2014

ER -

Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression

Abstract

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this