A Recipe for Empathy

Integrating the Mirror System, Insula, Somatosensory Cortex and Motherese

Angelica Lim, Hiroshi G. Okuno

    Research output: Contribution to journalArticle

    12 Citations (Scopus)

    Abstract

    Could a robot feel authentic empathy? What exactly is empathy, and why do most humans have it? We present a model which suggests that empathy is an emergent behavior with four main elements: a mirror neuron system, somatosensory cortices, an insula, and infant-directed “baby talk” or motherese. To test our hypothesis, we implemented a robot called MEI (multimodal emotional intelligence) with these functions, and allowed it to interact with human caregivers using comfort and approval motherese, the first kinds of vocalizations heard by infants at 3 and 6 months of age. The robot synchronized in real-time to the humans through voice and movement dynamics, while training statistical models associated with its low level gut feeling (“flourishing” or “distress”, based on battery or temperature). Experiments show that the post-interaction robot associates novel happy voices with physical flourishing 90 % of the time, sad voices with distress 84 % of the time. Our results also show that a robot trained with infant-directed “attention bids” can recognize adult fear voices. Importantly, this is the first emotion system to recognize adult emotional voices after training only with motherese, suggesting that this specific parental behavior may help build emotional intelligence.

    Original languageEnglish
    Pages (from-to)35-49
    Number of pages15
    JournalInternational Journal of Social Robotics
    Volume7
    Issue number1
    DOIs
    Publication statusPublished - 2015

    Fingerprint

    Mirrors
    Robots
    Neurons
    Experiments
    Temperature

    Keywords

    • Developmental robotics
    • Emotional contagion based on SIRE model
    • MEI robot
    • Robot empathy

    ASJC Scopus subject areas

    • Computer Science(all)

    Cite this

    A Recipe for Empathy : Integrating the Mirror System, Insula, Somatosensory Cortex and Motherese. / Lim, Angelica; Okuno, Hiroshi G.

    In: International Journal of Social Robotics, Vol. 7, No. 1, 2015, p. 35-49.

    Research output: Contribution to journalArticle

    @article{adb8ac359f914a339850adae6cc3f7db,
    title = "A Recipe for Empathy: Integrating the Mirror System, Insula, Somatosensory Cortex and Motherese",
    abstract = "Could a robot feel authentic empathy? What exactly is empathy, and why do most humans have it? We present a model which suggests that empathy is an emergent behavior with four main elements: a mirror neuron system, somatosensory cortices, an insula, and infant-directed “baby talk” or motherese. To test our hypothesis, we implemented a robot called MEI (multimodal emotional intelligence) with these functions, and allowed it to interact with human caregivers using comfort and approval motherese, the first kinds of vocalizations heard by infants at 3 and 6 months of age. The robot synchronized in real-time to the humans through voice and movement dynamics, while training statistical models associated with its low level gut feeling (“flourishing” or “distress”, based on battery or temperature). Experiments show that the post-interaction robot associates novel happy voices with physical flourishing 90 {\%} of the time, sad voices with distress 84 {\%} of the time. Our results also show that a robot trained with infant-directed “attention bids” can recognize adult fear voices. Importantly, this is the first emotion system to recognize adult emotional voices after training only with motherese, suggesting that this specific parental behavior may help build emotional intelligence.",
    keywords = "Developmental robotics, Emotional contagion based on SIRE model, MEI robot, Robot empathy",
    author = "Angelica Lim and Okuno, {Hiroshi G.}",
    year = "2015",
    doi = "10.1007/s12369-014-0262-y",
    language = "English",
    volume = "7",
    pages = "35--49",
    journal = "International Journal of Social Robotics",
    issn = "1875-4791",
    publisher = "Springer Verlag",
    number = "1",

    }

    TY - JOUR

    T1 - A Recipe for Empathy

    T2 - Integrating the Mirror System, Insula, Somatosensory Cortex and Motherese

    AU - Lim, Angelica

    AU - Okuno, Hiroshi G.

    PY - 2015

    Y1 - 2015

    N2 - Could a robot feel authentic empathy? What exactly is empathy, and why do most humans have it? We present a model which suggests that empathy is an emergent behavior with four main elements: a mirror neuron system, somatosensory cortices, an insula, and infant-directed “baby talk” or motherese. To test our hypothesis, we implemented a robot called MEI (multimodal emotional intelligence) with these functions, and allowed it to interact with human caregivers using comfort and approval motherese, the first kinds of vocalizations heard by infants at 3 and 6 months of age. The robot synchronized in real-time to the humans through voice and movement dynamics, while training statistical models associated with its low level gut feeling (“flourishing” or “distress”, based on battery or temperature). Experiments show that the post-interaction robot associates novel happy voices with physical flourishing 90 % of the time, sad voices with distress 84 % of the time. Our results also show that a robot trained with infant-directed “attention bids” can recognize adult fear voices. Importantly, this is the first emotion system to recognize adult emotional voices after training only with motherese, suggesting that this specific parental behavior may help build emotional intelligence.

    AB - Could a robot feel authentic empathy? What exactly is empathy, and why do most humans have it? We present a model which suggests that empathy is an emergent behavior with four main elements: a mirror neuron system, somatosensory cortices, an insula, and infant-directed “baby talk” or motherese. To test our hypothesis, we implemented a robot called MEI (multimodal emotional intelligence) with these functions, and allowed it to interact with human caregivers using comfort and approval motherese, the first kinds of vocalizations heard by infants at 3 and 6 months of age. The robot synchronized in real-time to the humans through voice and movement dynamics, while training statistical models associated with its low level gut feeling (“flourishing” or “distress”, based on battery or temperature). Experiments show that the post-interaction robot associates novel happy voices with physical flourishing 90 % of the time, sad voices with distress 84 % of the time. Our results also show that a robot trained with infant-directed “attention bids” can recognize adult fear voices. Importantly, this is the first emotion system to recognize adult emotional voices after training only with motherese, suggesting that this specific parental behavior may help build emotional intelligence.

    KW - Developmental robotics

    KW - Emotional contagion based on SIRE model

    KW - MEI robot

    KW - Robot empathy

    UR - http://www.scopus.com/inward/record.url?scp=84924287073&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84924287073&partnerID=8YFLogxK

    U2 - 10.1007/s12369-014-0262-y

    DO - 10.1007/s12369-014-0262-y

    M3 - Article

    VL - 7

    SP - 35

    EP - 49

    JO - International Journal of Social Robotics

    JF - International Journal of Social Robotics

    SN - 1875-4791

    IS - 1

    ER -