Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks

Sungmoon Jeong, Minho Lee, Hiroaki Arie, Jun Tani

研究成果: Conference contribution

7 引用 (Scopus)

抄録

In order to achieve visual-guided object manipulation tasks via learning by example, the current neuro-robotics study considers integration of two essential mechanisms of visual attention and arm/hand movement and their adaptive coordination. The present study proposes a new dynamic neural network model in which visual attention and motor behavior are associated with task specific manners by learning with selforganizing functional hierarchy required for the cognitive tasks. The top-down visual attention provides a goal-directed shift sequence in a visual scan path and it can guide a generation of a motor plan for hand movement during action by reinforcement and inhibition learning. The proposed model can automatically generate the corresponding goal-directed actions with regards to the current sensory states including visual stimuli and body postures. The experiments show that developmental learning from basic actions to combinational ones can achieve certain generalizations in learning by which some novel behaviors without prior learning can be successfully generated.

元の言語English
ホスト出版物のタイトル2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program
ページ165-170
ページ数6
DOI
出版物ステータスPublished - 2010
外部発表Yes
イベント2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Ann Arbor, MI
継続期間: 2010 8 182010 8 21

Other

Other2010 IEEE 9th International Conference on Development and Learning, ICDL-2010
Ann Arbor, MI
期間10/8/1810/8/21

Fingerprint

manipulation
learning
Reinforcement
Robotics
Neural networks
Experiments
reinforcement
neural network
stimulus
experiment

ASJC Scopus subject areas

  • Human-Computer Interaction
  • Software
  • Education

これを引用

Jeong, S., Lee, M., Arie, H., & Tani, J. (2010). Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks. : 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program (pp. 165-170). [5578849] https://doi.org/10.1109/DEVLRN.2010.5578849

Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks. / Jeong, Sungmoon; Lee, Minho; Arie, Hiroaki; Tani, Jun.

2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program. 2010. p. 165-170 5578849.

研究成果: Conference contribution

Jeong, S, Lee, M, Arie, H & Tani, J 2010, Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks. : 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program., 5578849, pp. 165-170, 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010, Ann Arbor, MI, 10/8/18. https://doi.org/10.1109/DEVLRN.2010.5578849
Jeong S, Lee M, Arie H, Tani J. Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks. : 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program. 2010. p. 165-170. 5578849 https://doi.org/10.1109/DEVLRN.2010.5578849
Jeong, Sungmoon ; Lee, Minho ; Arie, Hiroaki ; Tani, Jun. / Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks. 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program. 2010. pp. 165-170
@inproceedings{a89b3287524447d89fa987f051f569a6,
title = "Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks",
abstract = "In order to achieve visual-guided object manipulation tasks via learning by example, the current neuro-robotics study considers integration of two essential mechanisms of visual attention and arm/hand movement and their adaptive coordination. The present study proposes a new dynamic neural network model in which visual attention and motor behavior are associated with task specific manners by learning with selforganizing functional hierarchy required for the cognitive tasks. The top-down visual attention provides a goal-directed shift sequence in a visual scan path and it can guide a generation of a motor plan for hand movement during action by reinforcement and inhibition learning. The proposed model can automatically generate the corresponding goal-directed actions with regards to the current sensory states including visual stimuli and body postures. The experiments show that developmental learning from basic actions to combinational ones can achieve certain generalizations in learning by which some novel behaviors without prior learning can be successfully generated.",
keywords = "Action generator, Object manipulation task, Shift sequence in visual scan path",
author = "Sungmoon Jeong and Minho Lee and Hiroaki Arie and Jun Tani",
year = "2010",
doi = "10.1109/DEVLRN.2010.5578849",
language = "English",
isbn = "9781424469024",
pages = "165--170",
booktitle = "2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program",

}

TY - GEN

T1 - Developmental learning of integrating visual attention shifts and bimanual object grasping and manipulation tasks

AU - Jeong, Sungmoon

AU - Lee, Minho

AU - Arie, Hiroaki

AU - Tani, Jun

PY - 2010

Y1 - 2010

N2 - In order to achieve visual-guided object manipulation tasks via learning by example, the current neuro-robotics study considers integration of two essential mechanisms of visual attention and arm/hand movement and their adaptive coordination. The present study proposes a new dynamic neural network model in which visual attention and motor behavior are associated with task specific manners by learning with selforganizing functional hierarchy required for the cognitive tasks. The top-down visual attention provides a goal-directed shift sequence in a visual scan path and it can guide a generation of a motor plan for hand movement during action by reinforcement and inhibition learning. The proposed model can automatically generate the corresponding goal-directed actions with regards to the current sensory states including visual stimuli and body postures. The experiments show that developmental learning from basic actions to combinational ones can achieve certain generalizations in learning by which some novel behaviors without prior learning can be successfully generated.

AB - In order to achieve visual-guided object manipulation tasks via learning by example, the current neuro-robotics study considers integration of two essential mechanisms of visual attention and arm/hand movement and their adaptive coordination. The present study proposes a new dynamic neural network model in which visual attention and motor behavior are associated with task specific manners by learning with selforganizing functional hierarchy required for the cognitive tasks. The top-down visual attention provides a goal-directed shift sequence in a visual scan path and it can guide a generation of a motor plan for hand movement during action by reinforcement and inhibition learning. The proposed model can automatically generate the corresponding goal-directed actions with regards to the current sensory states including visual stimuli and body postures. The experiments show that developmental learning from basic actions to combinational ones can achieve certain generalizations in learning by which some novel behaviors without prior learning can be successfully generated.

KW - Action generator

KW - Object manipulation task

KW - Shift sequence in visual scan path

UR - http://www.scopus.com/inward/record.url?scp=78149251510&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=78149251510&partnerID=8YFLogxK

U2 - 10.1109/DEVLRN.2010.5578849

DO - 10.1109/DEVLRN.2010.5578849

M3 - Conference contribution

AN - SCOPUS:78149251510

SN - 9781424469024

SP - 165

EP - 170

BT - 2010 IEEE 9th International Conference on Development and Learning, ICDL-2010 - Conference Program

ER -