DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech

Laura Rachman, Marco Liuni, Pablo Arias, Andreas Lind, Petter Johansson, Lars Hall, Daniel Richardson, Katsumi Watanabe, Stéphanie Dubal, Jean Julien Aucouturier

    Research output: Contribution to journalArticle

    10 Citations (Scopus)

    Abstract

    We present an open-source software platform that transforms emotional cues expressed by speech signals using audio effects like pitch shifting, inflection, vibrato, and filtering. The emotional transformations can be applied to any audio file, but can also run in real time, using live input from a microphone, with less than 20-ms latency. We anticipate that this tool will be useful for the study of emotions in psychology and neuroscience, because it enables a high level of control over the acoustical and emotional content of experimental stimuli in a variety of laboratory situations, including real-time social situations. We present here results of a series of validation experiments aiming to position the tool against several methodological requirements: that transformed emotions be recognized at above-chance levels, valid in several languages (French, English, Swedish, and Japanese) and with a naturalness comparable to natural speech.

    Original languageEnglish
    Pages (from-to)1-21
    Number of pages21
    JournalBehavior Research Methods
    DOIs
    Publication statusAccepted/In press - 2017 Apr 3

      Fingerprint

    Keywords

    • Emotional transformations
    • Infra-segmental cues
    • Nonverbal behavior
    • Real-time
    • Software
    • Voice

    ASJC Scopus subject areas

    • Experimental and Cognitive Psychology
    • Psychology (miscellaneous)
    • Psychology(all)

    Cite this

    Rachman, L., Liuni, M., Arias, P., Lind, A., Johansson, P., Hall, L., Richardson, D., Watanabe, K., Dubal, S., & Aucouturier, J. J. (Accepted/In press). DAVID: An open-source platform for real-time transformation of infra-segmental emotional cues in running speech. Behavior Research Methods, 1-21. https://doi.org/10.3758/s13428-017-0873-y