Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks

Sungmoon Jeong, Minho Lee, Hiroaki Arie, Jun Tani

Research output: Chapter in Book/Report/Conference proceedingConference contribution

7 Citations (Scopus)

Abstract

In order to achieve visual-guided object manipulation tasks via learning by example, the current neuro-robotics study considers integration of two essential mechanisms of visual attention and arm/hand movement and their adaptive coordination. The present study proposes a new dynamic neural network model in which visual attention and motor behavior are associated with task specific manners by learning with selforganizing functional hierarchy required for the cognitive tasks. The top-down visual attention provides a goal-directed shift sequence in a visual scan path and it can guide a generation of a motor plan for hand movement during action by reinforcement and inhibition learning. The proposed model can automatically generate the corresponding goal-directed actions with regards to the current sensory states including visual stimuli and body postures. The experiments show that developmental learning from basic actions to combinational ones can achieve certain generalizations in learning by which some novel behaviors without prior learning can be successfully generated.

Original languageEnglish
Title of host publication2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program
Pages165-170
Number of pages6
DOIs
Publication statusPublished - 2010
Externally publishedYes
Event2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Ann Arbor, MI
Duration: 2010 Aug 182010 Aug 21

Other

Other2010 IEEE 9th International Conference on Development and Learning, ICDL-2010
CityAnn Arbor, MI
Period10/8/1810/8/21

Fingerprint

manipulation
learning
Reinforcement
Robotics
Neural networks
Experiments
reinforcement
neural network
stimulus
experiment

Keywords

  • Action generator
  • Object manipulation task
  • Shift sequence in visual scan path

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Software
  • Education

Cite this

Jeong, S., Lee, M., Arie, H., & Tani, J. (2010). Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks. In 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program (pp. 165-170). [5578849] https://doi.org/10.1109/DEVLRN.2010.5578849

Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks. / Jeong, Sungmoon; Lee, Minho; Arie, Hiroaki; Tani, Jun.

2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program. 2010. p. 165-170 5578849.

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Jeong, S, Lee, M, Arie, H & Tani, J 2010, Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks. in 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program., 5578849, pp. 165-170, 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010, Ann Arbor, MI, 10/8/18. https://doi.org/10.1109/DEVLRN.2010.5578849
Jeong S, Lee M, Arie H, Tani J. Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks. In 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program. 2010. p. 165-170. 5578849 https://doi.org/10.1109/DEVLRN.2010.5578849
Jeong, Sungmoon ; Lee, Minho ; Arie, Hiroaki ; Tani, Jun. / Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks. 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program. 2010. pp. 165-170
@inproceedings{a89b3287524447d89fa987f051f569a6,
title = "Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks",
abstract = "In order to achieve visual-guided object manipulation tasks via learning by example, the current neuro-robotics study considers integration of two essential mechanisms of visual attention and arm/hand movement and their adaptive coordination. The present study proposes a new dynamic neural network model in which visual attention and motor behavior are associated with task specific manners by learning with selforganizing functional hierarchy required for the cognitive tasks. The top-down visual attention provides a goal-directed shift sequence in a visual scan path and it can guide a generation of a motor plan for hand movement during action by reinforcement and inhibition learning. The proposed model can automatically generate the corresponding goal-directed actions with regards to the current sensory states including visual stimuli and body postures. The experiments show that developmental learning from basic actions to combinational ones can achieve certain generalizations in learning by which some novel behaviors without prior learning can be successfully generated.",
keywords = "Action generator, Object manipulation task, Shift sequence in visual scan path",
author = "Sungmoon Jeong and Minho Lee and Hiroaki Arie and Jun Tani",
year = "2010",
doi = "10.1109/DEVLRN.2010.5578849",
language = "English",
isbn = "9781424469024",
pages = "165--170",
booktitle = "2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program",

}

TY - GEN

T1 - Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks

AU - Jeong, Sungmoon

AU - Lee, Minho

AU - Arie, Hiroaki

AU - Tani, Jun

PY - 2010

Y1 - 2010

N2 - In order to achieve visual-guided object manipulation tasks via learning by example, the current neuro-robotics study considers integration of two essential mechanisms of visual attention and arm/hand movement and their adaptive coordination. The present study proposes a new dynamic neural network model in which visual attention and motor behavior are associated with task specific manners by learning with selforganizing functional hierarchy required for the cognitive tasks. The top-down visual attention provides a goal-directed shift sequence in a visual scan path and it can guide a generation of a motor plan for hand movement during action by reinforcement and inhibition learning. The proposed model can automatically generate the corresponding goal-directed actions with regards to the current sensory states including visual stimuli and body postures. The experiments show that developmental learning from basic actions to combinational ones can achieve certain generalizations in learning by which some novel behaviors without prior learning can be successfully generated.

AB - In order to achieve visual-guided object manipulation tasks via learning by example, the current neuro-robotics study considers integration of two essential mechanisms of visual attention and arm/hand movement and their adaptive coordination. The present study proposes a new dynamic neural network model in which visual attention and motor behavior are associated with task specific manners by learning with selforganizing functional hierarchy required for the cognitive tasks. The top-down visual attention provides a goal-directed shift sequence in a visual scan path and it can guide a generation of a motor plan for hand movement during action by reinforcement and inhibition learning. The proposed model can automatically generate the corresponding goal-directed actions with regards to the current sensory states including visual stimuli and body postures. The experiments show that developmental learning from basic actions to combinational ones can achieve certain generalizations in learning by which some novel behaviors without prior learning can be successfully generated.

KW - Action generator

KW - Object manipulation task

KW - Shift sequence in visual scan path

UR - http://www.scopus.com/inward/record.url?scp=78149251510&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78149251510&partnerID=8YFLogxK

U2 - 10.1109/DEVLRN.2010.5578849

DO - 10.1109/DEVLRN.2010.5578849

M3 - Conference contribution

AN - SCOPUS:78149251510

SN - 9781424469024

SP - 165

EP - 170

BT - 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program

ER -