Symbol emergence in robotics: a survey

Tadahiro Taniguchi, Takayuki Nagai, Tomoaki Nakamura, Naoto Iwahashi, Tetsuya Ogata, Hideki Asoh

    Research output: Contribution to journalArticle

    35 Citations (Scopus)

    Abstract

    Humans can learn a language through physical interaction with their environment and semiotic communication with other people. It is very important to obtain a computational understanding of how humans can form symbol systems and obtain semiotic skills through their autonomous mental development. Recently, many studies have been conducted regarding the construction of robotic systems and machine learning methods that can learn a language through embodied multimodal interaction with their environment and other systems. Understanding human?-social interactions and developing a robot that can smoothly communicate with human users in the long term require an understanding of the dynamics of symbol systems. The embodied cognition and social interaction of participants gradually alter a symbol system in a constructive manner. In this paper, we introduce a field of research called symbol emergence in robotics (SER). SER represents a constructive approach towards a symbol emergence system. The symbol emergence system is socially self-organized through both semiotic communications and physical interactions with autonomous cognitive developmental agents, i.e. humans and developmental robots. In this paper, specifically, we describe some state-of-art research topics concerning SER, such as multimodal categorization, word discovery, and double articulation analysis. They enable robots to discover words and their embodied meanings from raw sensory-motor information, including visual information, haptic information, auditory information, and acoustic speech signals, in a totally unsupervised manner. Finally, we suggest future directions for research in SER.

    Original languageEnglish
    Pages (from-to)1-23
    Number of pages23
    JournalAdvanced Robotics
    DOIs
    Publication statusAccepted/In press - 2016 Apr 12

      Fingerprint

    Keywords

    • Developmental robotics
    • language acquisition
    • semiotics
    • symbol emergence
    • symbol grounding

    ASJC Scopus subject areas

    • Control and Systems Engineering
    • Human-Computer Interaction
    • Computer Science Applications
    • Hardware and Architecture
    • Software

    Cite this

    Taniguchi, T., Nagai, T., Nakamura, T., Iwahashi, N., Ogata, T., & Asoh, H. (Accepted/In press). Symbol emergence in robotics: a survey. Advanced Robotics, 1-23. https://doi.org/10.1080/01691864.2016.1164622