Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks

Sungmoon Jeong, Minho Lee, Hiroaki Arie, Jun Tani

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

In order to achieve visual-guided object manipulation tasks via learning by example, the current neuro-robotics study considers integration of two essential mechanisms of visual attention and arm/hand movement and their adaptive coordination. The present study proposes a new dynamic neural network model in which visual attention and motor behavior are associated with task specific manners by learning with selforganizing functional hierarchy required for the cognitive tasks. The top-down visual attention provides a goal-directed shift sequence in a visual scan path and it can guide a generation of a motor plan for hand movement during action by reinforcement and inhibition learning. The proposed model can automatically generate the corresponding goal-directed actions with regards to the current sensory states including visual stimuli and body postures. The experiments show that developmental learning from basic actions to combinational ones can achieve certain generalizations in learning by which some novel behaviors without prior learning can be successfully generated.

Original languageEnglish
Title of host publication2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program
Pages165-170
Number of pages6
DOIs
Publication statusPublished - 2010
Externally publishedYes
Event2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Ann Arbor, MI
Duration: 2010 Aug 182010 Aug 21

Other

Other2010 IEEE 9th International Conference on Development and Learning, ICDL-2010
CityAnn Arbor, MI
Period10/8/1810/8/21

Keywords

  • Action generator
  • Object manipulation task
  • Shift sequence in visual scan path

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Software
  • Education

Fingerprint Dive into the research topics of 'Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks'. Together they form a unique fingerprint.

  • Cite this

    Jeong, S., Lee, M., Arie, H., & Tani, J. (2010). Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks. In 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program (pp. 165-170). [5578849] https://doi.org/10.1109/DEVLRN.2010.5578849