DAVID

An open-source platform for real-time transformation of infra-segmental emotional cues in running speech

Laura Rachman, Marco Liuni, Pablo Arias, Andreas Lind, Petter Johansson, Lars Hall, Daniel Richardson, Katsumi Watanabe, Stéphanie Dubal, Jean Julien Aucouturier

    Research output: Contribution to journalArticle

    8 Citations (Scopus)

    Abstract

    We present an open-source software platform that transforms emotional cues expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real time, using live input from a microphone, with less than 20-ms latency. We anticipate that this tool will be useful for the study of emotions in psychology and neuroscience, because it enables a high level of control over the acoustical and emotional content of experimental stimuli in a variety of laboratory situations, including real-time social situations. We present here results of a series of validation experiments aiming to position the tool against several methodological requirements: that transformed emotions be recognized at above-chance levels, valid in several languages (French, English, Swedish, and Japanese) and with a naturalness comparable to natural speech.

    Original languageEnglish
    Pages (from-to)1-21
    Number of pages21
    JournalBehavior Research Methods
    DOIs
    Publication statusAccepted/In press - 2017 Apr 3

    Fingerprint

    Cues
    Emotions
    Neurosciences
    Language
    Software
    Psychology
    Open Source
    Emotion

    Keywords

    • Emotional transformations
    • Infra-segmental cues
    • Nonverbal behavior
    • Real-time
    • Software
    • Voice

    ASJC Scopus subject areas

    • Experimental and Cognitive Psychology
    • Psychology (miscellaneous)
    • Psychology(all)

    Cite this

    Rachman, L., Liuni, M., Arias, P., Lind, A., Johansson, P., Hall, L., ... Aucouturier, J. J. (Accepted/In press). DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech. Behavior Research Methods, 1-21. https://doi.org/10.3758/s13428-017-0873-y

    DAVID : An open-source platform for real-time transformation of infra-segmental emotional cues in running speech. / Rachman, Laura; Liuni, Marco; Arias, Pablo; Lind, Andreas; Johansson, Petter; Hall, Lars; Richardson, Daniel; Watanabe, Katsumi; Dubal, Stéphanie; Aucouturier, Jean Julien.

    In: Behavior Research Methods, 03.04.2017, p. 1-21.

    Research output: Contribution to journalArticle

    Rachman, L, Liuni, M, Arias, P, Lind, A, Johansson, P, Hall, L, Richardson, D, Watanabe, K, Dubal, S & Aucouturier, JJ 2017, 'DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech', Behavior Research Methods, pp. 1-21. https://doi.org/10.3758/s13428-017-0873-y
    Rachman, Laura ; Liuni, Marco ; Arias, Pablo ; Lind, Andreas ; Johansson, Petter ; Hall, Lars ; Richardson, Daniel ; Watanabe, Katsumi ; Dubal, Stéphanie ; Aucouturier, Jean Julien. / DAVID : An open-source platform for real-time transformation of infra-segmental emotional cues in running speech. In: Behavior Research Methods. 2017 ; pp. 1-21.
    @article{1f754b08ba4942e4997e8c93056e1b20,
    title = "DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech",
    abstract = "We present an open-source software platform that transforms emotional cues expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real time, using live input from a microphone, with less than 20-ms latency. We anticipate that this tool will be useful for the study of emotions in psychology and neuroscience, because it enables a high level of control over the acoustical and emotional content of experimental stimuli in a variety of laboratory situations, including real-time social situations. We present here results of a series of validation experiments aiming to position the tool against several methodological requirements: that transformed emotions be recognized at above-chance levels, valid in several languages (French, English, Swedish, and Japanese) and with a naturalness comparable to natural speech.",
    keywords = "Emotional transformations, Infra-segmental cues, Nonverbal behavior, Real-time, Software, Voice",
    author = "Laura Rachman and Marco Liuni and Pablo Arias and Andreas Lind and Petter Johansson and Lars Hall and Daniel Richardson and Katsumi Watanabe and St{\'e}phanie Dubal and Aucouturier, {Jean Julien}",
    year = "2017",
    month = "4",
    day = "3",
    doi = "10.3758/s13428-017-0873-y",
    language = "English",
    pages = "1--21",
    journal = "Behavior Research Methods",
    issn = "1554-351X",
    publisher = "Springer New York",

    }

    TY - JOUR

    T1 - DAVID

    T2 - An open-source platform for real-time transformation of infra-segmental emotional cues in running speech

    AU - Rachman, Laura

    AU - Liuni, Marco

    AU - Arias, Pablo

    AU - Lind, Andreas

    AU - Johansson, Petter

    AU - Hall, Lars

    AU - Richardson, Daniel

    AU - Watanabe, Katsumi

    AU - Dubal, Stéphanie

    AU - Aucouturier, Jean Julien

    PY - 2017/4/3

    Y1 - 2017/4/3

    N2 - We present an open-source software platform that transforms emotional cues expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real time, using live input from a microphone, with less than 20-ms latency. We anticipate that this tool will be useful for the study of emotions in psychology and neuroscience, because it enables a high level of control over the acoustical and emotional content of experimental stimuli in a variety of laboratory situations, including real-time social situations. We present here results of a series of validation experiments aiming to position the tool against several methodological requirements: that transformed emotions be recognized at above-chance levels, valid in several languages (French, English, Swedish, and Japanese) and with a naturalness comparable to natural speech.

    AB - We present an open-source software platform that transforms emotional cues expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real time, using live input from a microphone, with less than 20-ms latency. We anticipate that this tool will be useful for the study of emotions in psychology and neuroscience, because it enables a high level of control over the acoustical and emotional content of experimental stimuli in a variety of laboratory situations, including real-time social situations. We present here results of a series of validation experiments aiming to position the tool against several methodological requirements: that transformed emotions be recognized at above-chance levels, valid in several languages (French, English, Swedish, and Japanese) and with a naturalness comparable to natural speech.

    KW - Emotional transformations

    KW - Infra-segmental cues

    KW - Nonverbal behavior

    KW - Real-time

    KW - Software

    KW - Voice

    UR - http://www.scopus.com/inward/record.url?scp=85016981246&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85016981246&partnerID=8YFLogxK

    U2 - 10.3758/s13428-017-0873-y

    DO - 10.3758/s13428-017-0873-y

    M3 - Article

    SP - 1

    EP - 21

    JO - Behavior Research Methods

    JF - Behavior Research Methods

    SN - 1554-351X

    ER -