Tool-body assimilation model using a neuro-dynamical system for acquiring representation of tool function and motion

Kuniyuki Takahshi, Tetsuya Ogata, Hadi Tjandra, Yuki Yamaguchi, Yuki Suga, Shigeki Sugano

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    3 Citations (Scopus)

    Abstract

    In this paper, we propose a tool-body assimilation model that implements a multiple time-scales recurrent neural network (MTRNN). Our model allows a robot to acquire the representation of a tool function and the required motion without having any prior knowledge of the tool. It is composed of five modules: image feature extraction, body model, tool dynamics feature, tool recognition, and motion recognition. Self-organizing maps (SOM) are used for image feature extraction from raw images. The MTRNN is used for body model learning. Parametric bias (PB) nodes are used to learn tool dynamic features. The PB nodes are attached to the neurons of the MTRNN to modulate the body model. A hierarchical neural network (HNN) is implemented for tool and motion recognition. Experiments were conducted using OpenHRP3, a robotics simulator, with multiple tools. The results show that the tool-body assimilation model is capable of recognizing tools, including those having an unlearned shape, and acquires the required motions accordingly.

    Original languageEnglish
    Title of host publicationIEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM
    PublisherInstitute of Electrical and Electronics Engineers Inc.
    Pages1255-1260
    Number of pages6
    ISBN (Print)9781479957361
    DOIs
    Publication statusPublished - 2014
    Event2014 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2014 - Besancon
    Duration: 2014 Jul 82014 Jul 11

    Other

    Other2014 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2014
    CityBesancon
    Period14/7/814/7/11

    Fingerprint

    Dynamical systems
    Recurrent neural networks
    Feature extraction
    Self organizing maps
    Neurons
    Robotics
    Simulators
    Robots
    Neural networks

    ASJC Scopus subject areas

    • Electrical and Electronic Engineering
    • Control and Systems Engineering
    • Computer Science Applications
    • Software

    Cite this

    Takahshi, K., Ogata, T., Tjandra, H., Yamaguchi, Y., Suga, Y., & Sugano, S. (2014). Tool-body assimilation model using a neuro-dynamical system for acquiring representation of tool function and motion. In IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM (pp. 1255-1260). [6878254] Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/AIM.2014.6878254

    Tool-body assimilation model using a neuro-dynamical system for acquiring representation of tool function and motion. / Takahshi, Kuniyuki; Ogata, Tetsuya; Tjandra, Hadi; Yamaguchi, Yuki; Suga, Yuki; Sugano, Shigeki.

    IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM. Institute of Electrical and Electronics Engineers Inc., 2014. p. 1255-1260 6878254.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Takahshi, K, Ogata, T, Tjandra, H, Yamaguchi, Y, Suga, Y & Sugano, S 2014, Tool-body assimilation model using a neuro-dynamical system for acquiring representation of tool function and motion. in IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM., 6878254, Institute of Electrical and Electronics Engineers Inc., pp. 1255-1260, 2014 IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM 2014, Besancon, 14/7/8. https://doi.org/10.1109/AIM.2014.6878254
    Takahshi K, Ogata T, Tjandra H, Yamaguchi Y, Suga Y, Sugano S. Tool-body assimilation model using a neuro-dynamical system for acquiring representation of tool function and motion. In IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM. Institute of Electrical and Electronics Engineers Inc. 2014. p. 1255-1260. 6878254 https://doi.org/10.1109/AIM.2014.6878254
    Takahshi, Kuniyuki ; Ogata, Tetsuya ; Tjandra, Hadi ; Yamaguchi, Yuki ; Suga, Yuki ; Sugano, Shigeki. / Tool-body assimilation model using a neuro-dynamical system for acquiring representation of tool function and motion. IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM. Institute of Electrical and Electronics Engineers Inc., 2014. pp. 1255-1260
    @inproceedings{5a358e33a9644a96a1a8502e20e4a285,
    title = "Tool-body assimilation model using a neuro-dynamical system for acquiring representation of tool function and motion",
    abstract = "In this paper, we propose a tool-body assimilation model that implements a multiple time-scales recurrent neural network (MTRNN). Our model allows a robot to acquire the representation of a tool function and the required motion without having any prior knowledge of the tool. It is composed of five modules: image feature extraction, body model, tool dynamics feature, tool recognition, and motion recognition. Self-organizing maps (SOM) are used for image feature extraction from raw images. The MTRNN is used for body model learning. Parametric bias (PB) nodes are used to learn tool dynamic features. The PB nodes are attached to the neurons of the MTRNN to modulate the body model. A hierarchical neural network (HNN) is implemented for tool and motion recognition. Experiments were conducted using OpenHRP3, a robotics simulator, with multiple tools. The results show that the tool-body assimilation model is capable of recognizing tools, including those having an unlearned shape, and acquires the required motions accordingly.",
    author = "Kuniyuki Takahshi and Tetsuya Ogata and Hadi Tjandra and Yuki Yamaguchi and Yuki Suga and Shigeki Sugano",
    year = "2014",
    doi = "10.1109/AIM.2014.6878254",
    language = "English",
    isbn = "9781479957361",
    pages = "1255--1260",
    booktitle = "IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM",
    publisher = "Institute of Electrical and Electronics Engineers Inc.",

    }

    TY - GEN

    T1 - Tool-body assimilation model using a neuro-dynamical system for acquiring representation of tool function and motion

    AU - Takahshi, Kuniyuki

    AU - Ogata, Tetsuya

    AU - Tjandra, Hadi

    AU - Yamaguchi, Yuki

    AU - Suga, Yuki

    AU - Sugano, Shigeki

    PY - 2014

    Y1 - 2014

    N2 - In this paper, we propose a tool-body assimilation model that implements a multiple time-scales recurrent neural network (MTRNN). Our model allows a robot to acquire the representation of a tool function and the required motion without having any prior knowledge of the tool. It is composed of five modules: image feature extraction, body model, tool dynamics feature, tool recognition, and motion recognition. Self-organizing maps (SOM) are used for image feature extraction from raw images. The MTRNN is used for body model learning. Parametric bias (PB) nodes are used to learn tool dynamic features. The PB nodes are attached to the neurons of the MTRNN to modulate the body model. A hierarchical neural network (HNN) is implemented for tool and motion recognition. Experiments were conducted using OpenHRP3, a robotics simulator, with multiple tools. The results show that the tool-body assimilation model is capable of recognizing tools, including those having an unlearned shape, and acquires the required motions accordingly.

    AB - In this paper, we propose a tool-body assimilation model that implements a multiple time-scales recurrent neural network (MTRNN). Our model allows a robot to acquire the representation of a tool function and the required motion without having any prior knowledge of the tool. It is composed of five modules: image feature extraction, body model, tool dynamics feature, tool recognition, and motion recognition. Self-organizing maps (SOM) are used for image feature extraction from raw images. The MTRNN is used for body model learning. Parametric bias (PB) nodes are used to learn tool dynamic features. The PB nodes are attached to the neurons of the MTRNN to modulate the body model. A hierarchical neural network (HNN) is implemented for tool and motion recognition. Experiments were conducted using OpenHRP3, a robotics simulator, with multiple tools. The results show that the tool-body assimilation model is capable of recognizing tools, including those having an unlearned shape, and acquires the required motions accordingly.

    UR - http://www.scopus.com/inward/record.url?scp=84906663404&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=84906663404&partnerID=8YFLogxK

    U2 - 10.1109/AIM.2014.6878254

    DO - 10.1109/AIM.2014.6878254

    M3 - Conference contribution

    AN - SCOPUS:84906663404

    SN - 9781479957361

    SP - 1255

    EP - 1260

    BT - IEEE/ASME International Conference on Advanced Intelligent Mechatronics, AIM

    PB - Institute of Electrical and Electronics Engineers Inc.

    ER -