Covert digital manipulation of vocal emotion alter speakers' emotional states in a congruent direction

Jean Julien Aucouturier, Petter Johansson, Lars Hall, Rodrigo Segnini, Lolita Mercadié, Katsumi Watanabe

    Research output: Contribution to journalArticle

    18 Citations (Scopus)

    Abstract

    Research has shown that people often exert control over their emotions. By modulating expressions, reappraising feelings, and redirecting attention, they can regulate their emotional experience. These findings have contributed to a blurring of the traditional boundaries between cognitive and emotional processes, and it has been suggested that emotional signals are produced in a goaldirected way and monitored for errors like other intentional actions. However, this interesting possibility has never been experimentally tested. To this end, we created a digital audio platform to covertly modify the emotional tone of participants' voices while they talked in the direction of happiness, sadness, or fear. The result showed that the audio transformations were being perceived as natural examples of the intended emotions, but the great majority of the participants, nevertheless, remained unaware that their own voices were being manipulated. This finding indicates that people are not continuously monitoring their own voice to make sure that it meets a predetermined emotional target. Instead, as a consequence of listening to their altered voices, the emotional state of the participants changed in congruence with the emotion portrayed, which was measured by both self-report and skin conductance level. This change is the first evidence, to our knowledge, of peripheral feedback effects on emotional experience in the auditory domain. As such, our result reinforces the wider framework of self-perception theory: that we often use the same inferential strategies to understand ourselves as those that we use to understand others.

    Original languageEnglish
    Pages (from-to)948-953
    Number of pages6
    JournalProceedings of the National Academy of Sciences of the United States of America
    Volume113
    Issue number4
    DOIs
    Publication statusPublished - 2016 Jan 26

    Fingerprint

    Emotions
    Happiness
    Self Concept
    Self Report
    Fear
    Skin
    Direction compound
    Research

    Keywords

    • Digital audio effects
    • Emotion monitoring
    • Self-perception
    • Vocal feedback
    • Voice emotion

    ASJC Scopus subject areas

    • General

    Cite this

    Covert digital manipulation of vocal emotion alter speakers' emotional states in a congruent direction. / Aucouturier, Jean Julien; Johansson, Petter; Hall, Lars; Segnini, Rodrigo; Mercadié, Lolita; Watanabe, Katsumi.

    In: Proceedings of the National Academy of Sciences of the United States of America, Vol. 113, No. 4, 26.01.2016, p. 948-953.

    Research output: Contribution to journalArticle

    Aucouturier, Jean Julien ; Johansson, Petter ; Hall, Lars ; Segnini, Rodrigo ; Mercadié, Lolita ; Watanabe, Katsumi. / Covert digital manipulation of vocal emotion alter speakers' emotional states in a congruent direction. In: Proceedings of the National Academy of Sciences of the United States of America. 2016 ; Vol. 113, No. 4. pp. 948-953.
    @article{ae3b2e5645d34508b0c43dc6a6041885,
    title = "Covert digital manipulation of vocal emotion alter speakers' emotional states in a congruent direction",
    abstract = "Research has shown that people often exert control over their emotions. By modulating expressions, reappraising feelings, and redirecting attention, they can regulate their emotional experience. These findings have contributed to a blurring of the traditional boundaries between cognitive and emotional processes, and it has been suggested that emotional signals are produced in a goaldirected way and monitored for errors like other intentional actions. However, this interesting possibility has never been experimentally tested. To this end, we created a digital audio platform to covertly modify the emotional tone of participants' voices while they talked in the direction of happiness, sadness, or fear. The result showed that the audio transformations were being perceived as natural examples of the intended emotions, but the great majority of the participants, nevertheless, remained unaware that their own voices were being manipulated. This finding indicates that people are not continuously monitoring their own voice to make sure that it meets a predetermined emotional target. Instead, as a consequence of listening to their altered voices, the emotional state of the participants changed in congruence with the emotion portrayed, which was measured by both self-report and skin conductance level. This change is the first evidence, to our knowledge, of peripheral feedback effects on emotional experience in the auditory domain. As such, our result reinforces the wider framework of self-perception theory: that we often use the same inferential strategies to understand ourselves as those that we use to understand others.",
    keywords = "Digital audio effects, Emotion monitoring, Self-perception, Vocal feedback, Voice emotion",
    author = "Aucouturier, {Jean Julien} and Petter Johansson and Lars Hall and Rodrigo Segnini and Lolita Mercadi{\'e} and Katsumi Watanabe",
    year = "2016",
    month = "1",
    day = "26",
    doi = "10.1073/pnas.1506552113",
    language = "English",
    volume = "113",
    pages = "948--953",
    journal = "Proceedings of the National Academy of Sciences of the United States of America",
    issn = "0027-8424",
    number = "4",

    }

    TY - JOUR

    T1 - Covert digital manipulation of vocal emotion alter speakers' emotional states in a congruent direction

    AU - Aucouturier, Jean Julien

    AU - Johansson, Petter

    AU - Hall, Lars

    AU - Segnini, Rodrigo

    AU - Mercadié, Lolita

    AU - Watanabe, Katsumi

    PY - 2016/1/26

    Y1 - 2016/1/26

    N2 - Research has shown that people often exert control over their emotions. By modulating expressions, reappraising feelings, and redirecting attention, they can regulate their emotional experience. These findings have contributed to a blurring of the traditional boundaries between cognitive and emotional processes, and it has been suggested that emotional signals are produced in a goaldirected way and monitored for errors like other intentional actions. However, this interesting possibility has never been experimentally tested. To this end, we created a digital audio platform to covertly modify the emotional tone of participants' voices while they talked in the direction of happiness, sadness, or fear. The result showed that the audio transformations were being perceived as natural examples of the intended emotions, but the great majority of the participants, nevertheless, remained unaware that their own voices were being manipulated. This finding indicates that people are not continuously monitoring their own voice to make sure that it meets a predetermined emotional target. Instead, as a consequence of listening to their altered voices, the emotional state of the participants changed in congruence with the emotion portrayed, which was measured by both self-report and skin conductance level. This change is the first evidence, to our knowledge, of peripheral feedback effects on emotional experience in the auditory domain. As such, our result reinforces the wider framework of self-perception theory: that we often use the same inferential strategies to understand ourselves as those that we use to understand others.

    AB - Research has shown that people often exert control over their emotions. By modulating expressions, reappraising feelings, and redirecting attention, they can regulate their emotional experience. These findings have contributed to a blurring of the traditional boundaries between cognitive and emotional processes, and it has been suggested that emotional signals are produced in a goaldirected way and monitored for errors like other intentional actions. However, this interesting possibility has never been experimentally tested. To this end, we created a digital audio platform to covertly modify the emotional tone of participants' voices while they talked in the direction of happiness, sadness, or fear. The result showed that the audio transformations were being perceived as natural examples of the intended emotions, but the great majority of the participants, nevertheless, remained unaware that their own voices were being manipulated. This finding indicates that people are not continuously monitoring their own voice to make sure that it meets a predetermined emotional target. Instead, as a consequence of listening to their altered voices, the emotional state of the participants changed in congruence with the emotion portrayed, which was measured by both self-report and skin conductance level. This change is the first evidence, to our knowledge, of peripheral feedback effects on emotional experience in the auditory domain. As such, our result reinforces the wider framework of self-perception theory: that we often use the same inferential strategies to understand ourselves as those that we use to understand others.

    KW - Digital audio effects

    KW - Emotion monitoring

    KW - Self-perception

    KW - Vocal feedback

    KW - Voice emotion

    UR - http://www.scopus.com/inward/record.url?scp=84955494222&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84955494222&partnerID=8YFLogxK

    U2 - 10.1073/pnas.1506552113

    DO - 10.1073/pnas.1506552113

    M3 - Article

    C2 - 26755584

    AN - SCOPUS:84955494222

    VL - 113

    SP - 948

    EP - 953

    JO - Proceedings of the National Academy of Sciences of the United States of America

    JF - Proceedings of the National Academy of Sciences of the United States of America

    SN - 0027-8424

    IS - 4

    ER -