Learning and evolution affected by spatial structure

Masahiro Ono, Mitsuru Ishizuka

Research output: Chapter in Book/Report/Conference proceedingConference contribution

4 Citations (Scopus)

Abstract

In this study, we explore the roles of learning and evolution in a non-cooperative autonomous system through a spatial IPD (Iterated Prisoner's Dilemma) game. First, we propose a new agent model playing the IPD game; the game has a gene of the coded parameters of reinforcement learning. The agents evolve and learn during the course of the game. Second, we report an empirical study. In our simulation, we observe that the spatial structure affects learning and evolution. Learning is not effective for achieving mutual cooperation except under certain special conditions. The learning process depends on the spatial structure.

Original languageEnglish
Title of host publicationLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages651-660
Number of pages10
Volume4099 LNAI
Publication statusPublished - 2006
Externally publishedYes
Event9th Pacific Rim International Conference on Artificial Intelligence - Guilin
Duration: 2006 Aug 72006 Aug 11

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume4099 LNAI
ISSN (Print)03029743
ISSN (Electronic)16113349

Other

Other9th Pacific Rim International Conference on Artificial Intelligence
CityGuilin
Period06/8/706/8/11

Fingerprint

Iterated Prisoner's Dilemma
Prisoner's Dilemma Game
Reinforcement learning
Spatial Structure
Genes
Learning
Game
Structure Learning
Autonomous Systems
Reinforcement Learning
Learning Process
Empirical Study
Gene
Simulation
Model

Keywords

  • Game theory
  • Prisoner's dilemma
  • Small world network

ASJC Scopus subject areas

  • Computer Science(all)
  • Biochemistry, Genetics and Molecular Biology(all)
  • Theoretical Computer Science

Cite this

Ono, M., & Ishizuka, M. (2006). Learning and evolution affected by spatial structure. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 4099 LNAI, pp. 651-660). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4099 LNAI).

Learning and evolution affected by spatial structure. / Ono, Masahiro; Ishizuka, Mitsuru.

Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4099 LNAI 2006. p. 651-660 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 4099 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Ono, M & Ishizuka, M 2006, Learning and evolution affected by spatial structure. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 4099 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 4099 LNAI, pp. 651-660, 9th Pacific Rim International Conference on Artificial Intelligence, Guilin, 06/8/7.
Ono M, Ishizuka M. Learning and evolution affected by spatial structure. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4099 LNAI. 2006. p. 651-660. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
Ono, Masahiro ; Ishizuka, Mitsuru. / Learning and evolution affected by spatial structure. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 4099 LNAI 2006. pp. 651-660 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{80b7b940ed014bed81752ef6c9df56d3,
title = "Learning and evolution affected by spatial structure",
abstract = "In this study, we explore the roles of learning and evolution in a non-cooperative autonomous system through a spatial IPD (Iterated Prisoner's Dilemma) game. First, we propose a new agent model playing the IPD game; the game has a gene of the coded parameters of reinforcement learning. The agents evolve and learn during the course of the game. Second, we report an empirical study. In our simulation, we observe that the spatial structure affects learning and evolution. Learning is not effective for achieving mutual cooperation except under certain special conditions. The learning process depends on the spatial structure.",
keywords = "Game theory, Prisoner's dilemma, Small world network",
author = "Masahiro Ono and Mitsuru Ishizuka",
year = "2006",
language = "English",
isbn = "3540366679",
volume = "4099 LNAI",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "651--660",
booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

}

TY - GEN

T1 - Learning and evolution affected by spatial structure

AU - Ono, Masahiro

AU - Ishizuka, Mitsuru

PY - 2006

Y1 - 2006

N2 - In this study, we explore the roles of learning and evolution in a non-cooperative autonomous system through a spatial IPD (Iterated Prisoner's Dilemma) game. First, we propose a new agent model playing the IPD game; the game has a gene of the coded parameters of reinforcement learning. The agents evolve and learn during the course of the game. Second, we report an empirical study. In our simulation, we observe that the spatial structure affects learning and evolution. Learning is not effective for achieving mutual cooperation except under certain special conditions. The learning process depends on the spatial structure.

AB - In this study, we explore the roles of learning and evolution in a non-cooperative autonomous system through a spatial IPD (Iterated Prisoner's Dilemma) game. First, we propose a new agent model playing the IPD game; the game has a gene of the coded parameters of reinforcement learning. The agents evolve and learn during the course of the game. Second, we report an empirical study. In our simulation, we observe that the spatial structure affects learning and evolution. Learning is not effective for achieving mutual cooperation except under certain special conditions. The learning process depends on the spatial structure.

KW - Game theory

KW - Prisoner's dilemma

KW - Small world network

UR - http://www.scopus.com/inward/record.url?scp=33749544794&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=33749544794&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:33749544794

SN - 3540366679

SN - 9783540366676

VL - 4099 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 651

EP - 660

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

ER -