Integrative learning between language and action: A neuro-robotics experiment

Hiroaki Arie, Tetsuro Endo, Sungmoon Jeong, Minho Lee, Shigeki Sugano, Jun Tani

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

This paper introduces a model for associative learning combining both linguistic and behavior modalities. The model consists of language and behavior modules both implemented by a hierarchical dynamic network model and interacting densely through hub-like neurons, the so-called parametric biases (PB). By implementing this model for a humanoid robot with the task of manipulating multiple objects, the robot was tutored to associate sentences of two different grammatical types with corresponding sensory-motor schemata. The first type was a verb followed by an objective noun such as "hold red" or "hit blue"; the second was a verb followed by an objective noun and further followed by an adverb phrase such as "Put red on blue". Our analysis of the results of a learning experiment showed that two clusters corresponding to these two types of grammatical sentences appear in the PB activity space, such that a specific micro structure is organized for each cluster.

Original languageEnglish
Title of host publicationArtificial Neural Networks, ICANN 2010 - 20th International Conference, Proceedings
Pages256-265
Number of pages10
EditionPART 2
DOIs
Publication statusPublished - 2010 Nov 8
Event20th International Conference on Artificial Neural Networks, ICANN 2010 - Thessaloniki, Greece
Duration: 2010 Sep 152010 Sep 18

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
NumberPART 2
Volume6353 LNCS
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Conference

Conference20th International Conference on Artificial Neural Networks, ICANN 2010
CountryGreece
CityThessaloniki
Period10/9/1510/9/18

ASJC Scopus subject areas

  • Theoretical Computer Science
  • Computer Science(all)

Fingerprint Dive into the research topics of 'Integrative learning between language and action: A neuro-robotics experiment'. Together they form a unique fingerprint.

Cite this