A study on real-time scheduling for holonic manufacturing systems - Determination of utility values based on multi-agent reinforcement learning

Koji Iwamura, Norihisa Mayumi, Yoshitaka Tanimizu, Nobuhiro Sugimura

Research output: Chapter in Book/Report/Conference proceedingConference contribution

3 Citations (Scopus)

Abstract

This paper deals with a real-time scheduling method for holonic manufacturing systems (HMS). In the previous paper, a real-time scheduling method based on utility values has been proposed and applied to the HMS. In the proposed method, all the job holons and the resource holons firstly evaluate the utility values for the cases where the holon selects the individual candidate holons for the next machining operations. The coordination holon secondly determine a suitable combination of the resource holons and the job holons which carry out the next machining operations, based on the utility values. Multi-agent reinforcement learning is newly proposed and implemented to the job holons and the resource holons, in order to improve their capabilities for evaluating the utility values of the candidate holons. The individual job holons and resource holons evaluate the suitable utility values according to the status of the HMS, by applying the proposed learning method.

Original languageEnglish
Title of host publicationHolonic and Multi-Agent Systems for Manufacturing - 4th International Conference on Industrial Applications of Holonic and Multi-Agent Systems, HoloMAS 2009, Proceedings
Pages135-144
Number of pages10
DOIs
Publication statusPublished - 2009 Sep 28
Externally publishedYes
Event4th International Conference on Industrial Applications of Holonic and Multi-Agent Systems, HoloMAS 2009 - Linz, Austria
Duration: 2009 Aug 312009 Sep 2

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume5696 LNAI
ISSN (Print)0302-9743
ISSN (Electronic)1611-3349

Other

Other4th International Conference on Industrial Applications of Holonic and Multi-Agent Systems, HoloMAS 2009
CountryAustria
CityLinz
Period09/8/3109/9/2

Fingerprint

Multiagent Learning
Reinforcement learning
Reinforcement Learning
Scheduling
Real-time
Machining
Resources
Evaluate

Keywords

  • Coordination
  • Holonic Manufacturing Systems
  • Multi-agent Reinforcement Learning
  • Real-time Scheduling

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science

Cite this

Iwamura, K., Mayumi, N., Tanimizu, Y., & Sugimura, N. (2009). A study on real-time scheduling for holonic manufacturing systems - Determination of utility values based on multi-agent reinforcement learning. In Holonic and Multi-Agent Systems for Manufacturing - 4th International Conference on Industrial Applications of Holonic and Multi-Agent Systems, HoloMAS 2009, Proceedings (pp. 135-144). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5696 LNAI). https://doi.org/10.1007/978-3-642-03668-2_13

A study on real-time scheduling for holonic manufacturing systems - Determination of utility values based on multi-agent reinforcement learning. / Iwamura, Koji; Mayumi, Norihisa; Tanimizu, Yoshitaka; Sugimura, Nobuhiro.

Holonic and Multi-Agent Systems for Manufacturing - 4th International Conference on Industrial Applications of Holonic and Multi-Agent Systems, HoloMAS 2009, Proceedings. 2009. p. 135-144 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5696 LNAI).

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Iwamura, K, Mayumi, N, Tanimizu, Y & Sugimura, N 2009, A study on real-time scheduling for holonic manufacturing systems - Determination of utility values based on multi-agent reinforcement learning. in Holonic and Multi-Agent Systems for Manufacturing - 4th International Conference on Industrial Applications of Holonic and Multi-Agent Systems, HoloMAS 2009, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5696 LNAI, pp. 135-144, 4th International Conference on Industrial Applications of Holonic and Multi-Agent Systems, HoloMAS 2009, Linz, Austria, 09/8/31. https://doi.org/10.1007/978-3-642-03668-2_13
Iwamura K, Mayumi N, Tanimizu Y, Sugimura N. A study on real-time scheduling for holonic manufacturing systems - Determination of utility values based on multi-agent reinforcement learning. In Holonic and Multi-Agent Systems for Manufacturing - 4th International Conference on Industrial Applications of Holonic and Multi-Agent Systems, HoloMAS 2009, Proceedings. 2009. p. 135-144. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). https://doi.org/10.1007/978-3-642-03668-2_13
Iwamura, Koji ; Mayumi, Norihisa ; Tanimizu, Yoshitaka ; Sugimura, Nobuhiro. / A study on real-time scheduling for holonic manufacturing systems - Determination of utility values based on multi-agent reinforcement learning. Holonic and Multi-Agent Systems for Manufacturing - 4th International Conference on Industrial Applications of Holonic and Multi-Agent Systems, HoloMAS 2009, Proceedings. 2009. pp. 135-144 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).
@inproceedings{f53a04f7f27541cda6ba293e0a588c52,
title = "A study on real-time scheduling for holonic manufacturing systems - Determination of utility values based on multi-agent reinforcement learning",
abstract = "This paper deals with a real-time scheduling method for holonic manufacturing systems (HMS). In the previous paper, a real-time scheduling method based on utility values has been proposed and applied to the HMS. In the proposed method, all the job holons and the resource holons firstly evaluate the utility values for the cases where the holon selects the individual candidate holons for the next machining operations. The coordination holon secondly determine a suitable combination of the resource holons and the job holons which carry out the next machining operations, based on the utility values. Multi-agent reinforcement learning is newly proposed and implemented to the job holons and the resource holons, in order to improve their capabilities for evaluating the utility values of the candidate holons. The individual job holons and resource holons evaluate the suitable utility values according to the status of the HMS, by applying the proposed learning method.",
keywords = "Coordination, Holonic Manufacturing Systems, Multi-agent Reinforcement Learning, Real-time Scheduling",
author = "Koji Iwamura and Norihisa Mayumi and Yoshitaka Tanimizu and Nobuhiro Sugimura",
year = "2009",
month = "9",
day = "28",
doi = "10.1007/978-3-642-03668-2_13",
language = "English",
isbn = "364203666X",
series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",
pages = "135--144",
booktitle = "Holonic and Multi-Agent Systems for Manufacturing - 4th International Conference on Industrial Applications of Holonic and Multi-Agent Systems, HoloMAS 2009, Proceedings",

}

TY - GEN

T1 - A study on real-time scheduling for holonic manufacturing systems - Determination of utility values based on multi-agent reinforcement learning

AU - Iwamura, Koji

AU - Mayumi, Norihisa

AU - Tanimizu, Yoshitaka

AU - Sugimura, Nobuhiro

PY - 2009/9/28

Y1 - 2009/9/28

N2 - This paper deals with a real-time scheduling method for holonic manufacturing systems (HMS). In the previous paper, a real-time scheduling method based on utility values has been proposed and applied to the HMS. In the proposed method, all the job holons and the resource holons firstly evaluate the utility values for the cases where the holon selects the individual candidate holons for the next machining operations. The coordination holon secondly determine a suitable combination of the resource holons and the job holons which carry out the next machining operations, based on the utility values. Multi-agent reinforcement learning is newly proposed and implemented to the job holons and the resource holons, in order to improve their capabilities for evaluating the utility values of the candidate holons. The individual job holons and resource holons evaluate the suitable utility values according to the status of the HMS, by applying the proposed learning method.

AB - This paper deals with a real-time scheduling method for holonic manufacturing systems (HMS). In the previous paper, a real-time scheduling method based on utility values has been proposed and applied to the HMS. In the proposed method, all the job holons and the resource holons firstly evaluate the utility values for the cases where the holon selects the individual candidate holons for the next machining operations. The coordination holon secondly determine a suitable combination of the resource holons and the job holons which carry out the next machining operations, based on the utility values. Multi-agent reinforcement learning is newly proposed and implemented to the job holons and the resource holons, in order to improve their capabilities for evaluating the utility values of the candidate holons. The individual job holons and resource holons evaluate the suitable utility values according to the status of the HMS, by applying the proposed learning method.

KW - Coordination

KW - Holonic Manufacturing Systems

KW - Multi-agent Reinforcement Learning

KW - Real-time Scheduling

UR - http://www.scopus.com/inward/record.url?scp=70349307055&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70349307055&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-03668-2_13

DO - 10.1007/978-3-642-03668-2_13

M3 - Conference contribution

AN - SCOPUS:70349307055

SN - 364203666X

SN - 9783642036668

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 135

EP - 144

BT - Holonic and Multi-Agent Systems for Manufacturing - 4th International Conference on Industrial Applications of Holonic and Multi-Agent Systems, HoloMAS 2009, Proceedings

ER -