Multimedia sensing system for robot

Toru Kurata, Dingding Chang, Shuji Hashimoto

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    6 Citations (Scopus)

    Abstract

    The purpose of this study is to realize a multi-media sensing system for robot. Using both image and sound processing, the system makes a robot track a person who is speaking. The sound direction is calculated from the phase difference between sounds from two microphones at the right and left ear positions. Then by detecting synchronization between the sound and image changing, the system identifies the speaker. Furthermore, by introducing a multi-level synchronization checking and context analysis, the action pattern of the robot can be regulated to make the robot work in the complicated environment where plural speakers exist. All the processes are performed in real-time. The proposed system is implemented in the information assistant robot 'Hadaly'.

    Original languageEnglish
    Title of host publicationRobot and Human Communication - Proceedings of the IEEE International Workshop
    Pages83-88
    Number of pages6
    Publication statusPublished - 1995
    EventProceedings of the 1995 4th IEEE International Workshop on Robot and Human Communication, RO-MAN - Tokyo, Jpn
    Duration: 1995 Jul 51995 Jul 7

    Other

    OtherProceedings of the 1995 4th IEEE International Workshop on Robot and Human Communication, RO-MAN
    CityTokyo, Jpn
    Period95/7/595/7/7

    Fingerprint

    Robots
    Acoustic waves
    Synchronization
    Microphones
    Processing

    ASJC Scopus subject areas

    • Hardware and Architecture
    • Software

    Cite this

    Kurata, T., Chang, D., & Hashimoto, S. (1995). Multimedia sensing system for robot. In Robot and Human Communication - Proceedings of the IEEE International Workshop (pp. 83-88)

    Multimedia sensing system for robot. / Kurata, Toru; Chang, Dingding; Hashimoto, Shuji.

    Robot and Human Communication - Proceedings of the IEEE International Workshop. 1995. p. 83-88.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Kurata, T, Chang, D & Hashimoto, S 1995, Multimedia sensing system for robot. in Robot and Human Communication - Proceedings of the IEEE International Workshop. pp. 83-88, Proceedings of the 1995 4th IEEE International Workshop on Robot and Human Communication, RO-MAN, Tokyo, Jpn, 95/7/5.
    Kurata T, Chang D, Hashimoto S. Multimedia sensing system for robot. In Robot and Human Communication - Proceedings of the IEEE International Workshop. 1995. p. 83-88
    Kurata, Toru ; Chang, Dingding ; Hashimoto, Shuji. / Multimedia sensing system for robot. Robot and Human Communication - Proceedings of the IEEE International Workshop. 1995. pp. 83-88
    @inproceedings{c6970addf07d43a393138e7bd7b2a45f,
    title = "Multimedia sensing system for robot",
    abstract = "The purpose of this study is to realize a multi-media sensing system for robot. Using both image and sound processing, the system makes a robot track a person who is speaking. The sound direction is calculated from the phase difference between sounds from two microphones at the right and left ear positions. Then by detecting synchronization between the sound and image changing, the system identifies the speaker. Furthermore, by introducing a multi-level synchronization checking and context analysis, the action pattern of the robot can be regulated to make the robot work in the complicated environment where plural speakers exist. All the processes are performed in real-time. The proposed system is implemented in the information assistant robot 'Hadaly'.",
    author = "Toru Kurata and Dingding Chang and Shuji Hashimoto",
    year = "1995",
    language = "English",
    pages = "83--88",
    booktitle = "Robot and Human Communication - Proceedings of the IEEE International Workshop",

    }

    TY - GEN

    T1 - Multimedia sensing system for robot

    AU - Kurata, Toru

    AU - Chang, Dingding

    AU - Hashimoto, Shuji

    PY - 1995

    Y1 - 1995

    N2 - The purpose of this study is to realize a multi-media sensing system for robot. Using both image and sound processing, the system makes a robot track a person who is speaking. The sound direction is calculated from the phase difference between sounds from two microphones at the right and left ear positions. Then by detecting synchronization between the sound and image changing, the system identifies the speaker. Furthermore, by introducing a multi-level synchronization checking and context analysis, the action pattern of the robot can be regulated to make the robot work in the complicated environment where plural speakers exist. All the processes are performed in real-time. The proposed system is implemented in the information assistant robot 'Hadaly'.

    AB - The purpose of this study is to realize a multi-media sensing system for robot. Using both image and sound processing, the system makes a robot track a person who is speaking. The sound direction is calculated from the phase difference between sounds from two microphones at the right and left ear positions. Then by detecting synchronization between the sound and image changing, the system identifies the speaker. Furthermore, by introducing a multi-level synchronization checking and context analysis, the action pattern of the robot can be regulated to make the robot work in the complicated environment where plural speakers exist. All the processes are performed in real-time. The proposed system is implemented in the information assistant robot 'Hadaly'.

    UR - http://www.scopus.com/inward/record.url?scp=0029522716&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=0029522716&partnerID=8YFLogxK

    M3 - Conference contribution

    SP - 83

    EP - 88

    BT - Robot and Human Communication - Proceedings of the IEEE International Workshop

    ER -