Neuro-robotics study on integrative learning of proactive visual attention and motor behaviors

Sungmoon Jeong, Hiroaki Arie, Minho Lee, Jun Tani

Research output: Contribution to journalArticle

16 Citations (Scopus)

Abstract

The current paper proposes a novel model for integrative learning of proactive visual attention and sensory- motor control as inspired by the premotor theory of visual attention. The model is characterized by coupling a slow dynamics network with a fast dynamics network and by inheriting our prior proposed multiple timescales recurrent neural networks model (MTRNN) that may correspond to the fronto-parietal networks in the cortical brains. The neuro-robotics experiments in a task of manipulating multiple objects utilizing the proposed model demonstrated that some degrees of generalization in terms of position and object size variation can be achieved by organizing seamless integration of the proactive objectrelated visual attention and the related sensory-motor control into a set of action primitives in the distributed neural activities appearing in the fast dynamics network. It was also shown that such action primitives can be combined in compositional ways in acquiring novel actions in the slow dynamics network. The experimental results presented substantiate the premotor theory of visual attention.

Original languageEnglish
Pages (from-to)43-59
Number of pages17
JournalCognitive Neurodynamics
Volume6
Issue number1
DOIs
Publication statusPublished - 2012 Feb
Externally publishedYes

Fingerprint

Robotics
Learning
Neural Networks (Computer)
Brain

Keywords

  • Multiple objects manipulation task
  • Multiple time recurrent neural networks
  • Premotor theory of visual attention
  • Proactive visual attention

ASJC Scopus subject areas

  • Cognitive Neuroscience

Cite this

Neuro-robotics study on integrative learning of proactive visual attention and motor behaviors. / Jeong, Sungmoon; Arie, Hiroaki; Lee, Minho; Tani, Jun.

In: Cognitive Neurodynamics, Vol. 6, No. 1, 02.2012, p. 43-59.

Research output: Contribution to journalArticle

Jeong, Sungmoon ; Arie, Hiroaki ; Lee, Minho ; Tani, Jun. / Neuro-robotics study on integrative learning of proactive visual attention and motor behaviors. In: Cognitive Neurodynamics. 2012 ; Vol. 6, No. 1. pp. 43-59.
@article{f0cb191d2b9d4e8bbe3ed4a6738717a7,
title = "Neuro-robotics study on integrative learning of proactive visual attention and motor behaviors",
abstract = "The current paper proposes a novel model for integrative learning of proactive visual attention and sensory- motor control as inspired by the premotor theory of visual attention. The model is characterized by coupling a slow dynamics network with a fast dynamics network and by inheriting our prior proposed multiple timescales recurrent neural networks model (MTRNN) that may correspond to the fronto-parietal networks in the cortical brains. The neuro-robotics experiments in a task of manipulating multiple objects utilizing the proposed model demonstrated that some degrees of generalization in terms of position and object size variation can be achieved by organizing seamless integration of the proactive objectrelated visual attention and the related sensory-motor control into a set of action primitives in the distributed neural activities appearing in the fast dynamics network. It was also shown that such action primitives can be combined in compositional ways in acquiring novel actions in the slow dynamics network. The experimental results presented substantiate the premotor theory of visual attention.",
keywords = "Multiple objects manipulation task, Multiple time recurrent neural networks, Premotor theory of visual attention, Proactive visual attention",
author = "Sungmoon Jeong and Hiroaki Arie and Minho Lee and Jun Tani",
year = "2012",
month = "2",
doi = "10.1007/s11571-011-9176-7",
language = "English",
volume = "6",
pages = "43--59",
journal = "Cognitive Neurodynamics",
issn = "1871-4080",
publisher = "Springer Netherlands",
number = "1",

}

TY - JOUR

T1 - Neuro-robotics study on integrative learning of proactive visual attention and motor behaviors

AU - Jeong, Sungmoon

AU - Arie, Hiroaki

AU - Lee, Minho

AU - Tani, Jun

PY - 2012/2

Y1 - 2012/2

N2 - The current paper proposes a novel model for integrative learning of proactive visual attention and sensory- motor control as inspired by the premotor theory of visual attention. The model is characterized by coupling a slow dynamics network with a fast dynamics network and by inheriting our prior proposed multiple timescales recurrent neural networks model (MTRNN) that may correspond to the fronto-parietal networks in the cortical brains. The neuro-robotics experiments in a task of manipulating multiple objects utilizing the proposed model demonstrated that some degrees of generalization in terms of position and object size variation can be achieved by organizing seamless integration of the proactive objectrelated visual attention and the related sensory-motor control into a set of action primitives in the distributed neural activities appearing in the fast dynamics network. It was also shown that such action primitives can be combined in compositional ways in acquiring novel actions in the slow dynamics network. The experimental results presented substantiate the premotor theory of visual attention.

AB - The current paper proposes a novel model for integrative learning of proactive visual attention and sensory- motor control as inspired by the premotor theory of visual attention. The model is characterized by coupling a slow dynamics network with a fast dynamics network and by inheriting our prior proposed multiple timescales recurrent neural networks model (MTRNN) that may correspond to the fronto-parietal networks in the cortical brains. The neuro-robotics experiments in a task of manipulating multiple objects utilizing the proposed model demonstrated that some degrees of generalization in terms of position and object size variation can be achieved by organizing seamless integration of the proactive objectrelated visual attention and the related sensory-motor control into a set of action primitives in the distributed neural activities appearing in the fast dynamics network. It was also shown that such action primitives can be combined in compositional ways in acquiring novel actions in the slow dynamics network. The experimental results presented substantiate the premotor theory of visual attention.

KW - Multiple objects manipulation task

KW - Multiple time recurrent neural networks

KW - Premotor theory of visual attention

KW - Proactive visual attention

UR - http://www.scopus.com/inward/record.url?scp=84860834963&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84860834963&partnerID=8YFLogxK

U2 - 10.1007/s11571-011-9176-7

DO - 10.1007/s11571-011-9176-7

M3 - Article

VL - 6

SP - 43

EP - 59

JO - Cognitive Neurodynamics

JF - Cognitive Neurodynamics

SN - 1871-4080

IS - 1

ER -