Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression

Kanako Watanabe, Yoko Greenberg, Yoshinori Sagisaka

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    3 Citations (Scopus)

    Abstract

    In this paper, the sentiment correlation between color and speech has been investigated aiming at multimodal expression of information embedded in speech. To cope with the necessity of information specification for further analyses and control of speech so called para-linguistic information, we carried out an sentiment experiment on the correlations between speech characteristics and color attributes associated by perceptual impressions. Using five vowel categories with twelve different prosodie patterns, we found high correlations between speech features (vowel categories and FO) and three attributes of color (hue, saturation and value). These correlations open up wide possibilities to describe and quantitatively analyze speech information that has not yet been systematically studied but partially treated as emotional variants or para-linguistic information.

    Original languageEnglish
    Title of host publication2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    ISBN (Electronic)9786163618238
    DOIs
    Publication statusPublished - 2014 Feb 12
    Event2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014 - Chiang Mai, Thailand
    Duration: 2014 Dec 92014 Dec 12

    Other

    Other2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014
    CountryThailand
    CityChiang Mai
    Period14/12/914/12/12

    ASJC Scopus subject areas

    • Signal Processing
    • Information Systems

    Fingerprint Dive into the research topics of 'Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression'. Together they form a unique fingerprint.

  • Cite this

    Watanabe, K., Greenberg, Y., & Sagisaka, Y. (2014). Sentiment analysis of color attributes derived from vowel sound impression for multimodal expression. In 2014 Asia-Pacific Signal and Information Processing Association Annual Summit and Conference, APSIPA 2014 [7041586] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/APSIPA.2014.7041586