Emergence of divisional cooperation with negotiation and re-learning and evaluation of flexibility in continuous cooperative patrol problem

Ayumi Sugiyama, Vourchteang Sea, Toshiharu Sugawara

    Research output: Contribution to journalArticle

    Abstract

    We propose a learning and negotiation method to enhance divisional cooperation and demonstrate its flexibility for adapting to environmental changes in the context of the multi-agent cooperative problem. We now have access to a vast array of information, and everything has become more closely connected. However, this makes tasks/problems in these environments complicated. In particular, we often require fast decision-making and flexible responses to follow environmental changes. For these requirements, multi-agent systems have been attracting interest, but the manner in which multiple agents cooperate is a challenging issue because of the computational cost, environmental complexity, and sophisticated interaction between agents. In this work, we address the continuous cooperative patrol problem, which requires cooperation based on high autonomy, and propose an autonomous learning method with simple negotiation to enhance divisional cooperation for efficient work. We also investigate how this method can have high flexibility to adapt to change. We experimentally show that agents with our method generate several types of role sharing in a bottom-up manner for effective and flexible divisional cooperation. The results also show that agents using our method appropriately change their roles in different environmental change scenarios and enhance the overall efficiency and flexibility.

    Original languageEnglish
    JournalKnowledge and Information Systems
    DOIs
    Publication statusAccepted/In press - 2018 Jan 1

    Fingerprint

    Multi agent systems
    Decision making
    Costs

    Keywords

    • Autonomous learning
    • Continuous patrolling
    • Divisional cooperation
    • Multi-agent system

    ASJC Scopus subject areas

    • Software
    • Information Systems
    • Human-Computer Interaction
    • Hardware and Architecture
    • Artificial Intelligence

    Cite this

    @article{c5ef40b715ac4ad59b4bed9b4635998b,
    title = "Emergence of divisional cooperation with negotiation and re-learning and evaluation of flexibility in continuous cooperative patrol problem",
    abstract = "We propose a learning and negotiation method to enhance divisional cooperation and demonstrate its flexibility for adapting to environmental changes in the context of the multi-agent cooperative problem. We now have access to a vast array of information, and everything has become more closely connected. However, this makes tasks/problems in these environments complicated. In particular, we often require fast decision-making and flexible responses to follow environmental changes. For these requirements, multi-agent systems have been attracting interest, but the manner in which multiple agents cooperate is a challenging issue because of the computational cost, environmental complexity, and sophisticated interaction between agents. In this work, we address the continuous cooperative patrol problem, which requires cooperation based on high autonomy, and propose an autonomous learning method with simple negotiation to enhance divisional cooperation for efficient work. We also investigate how this method can have high flexibility to adapt to change. We experimentally show that agents with our method generate several types of role sharing in a bottom-up manner for effective and flexible divisional cooperation. The results also show that agents using our method appropriately change their roles in different environmental change scenarios and enhance the overall efficiency and flexibility.",
    keywords = "Autonomous learning, Continuous patrolling, Divisional cooperation, Multi-agent system",
    author = "Ayumi Sugiyama and Vourchteang Sea and Toshiharu Sugawara",
    year = "2018",
    month = "1",
    day = "1",
    doi = "10.1007/s10115-018-1285-8",
    language = "English",
    journal = "Knowledge and Information Systems",
    issn = "0219-1377",
    publisher = "Springer London",

    }

    TY - JOUR

    T1 - Emergence of divisional cooperation with negotiation and re-learning and evaluation of flexibility in continuous cooperative patrol problem

    AU - Sugiyama, Ayumi

    AU - Sea, Vourchteang

    AU - Sugawara, Toshiharu

    PY - 2018/1/1

    Y1 - 2018/1/1

    N2 - We propose a learning and negotiation method to enhance divisional cooperation and demonstrate its flexibility for adapting to environmental changes in the context of the multi-agent cooperative problem. We now have access to a vast array of information, and everything has become more closely connected. However, this makes tasks/problems in these environments complicated. In particular, we often require fast decision-making and flexible responses to follow environmental changes. For these requirements, multi-agent systems have been attracting interest, but the manner in which multiple agents cooperate is a challenging issue because of the computational cost, environmental complexity, and sophisticated interaction between agents. In this work, we address the continuous cooperative patrol problem, which requires cooperation based on high autonomy, and propose an autonomous learning method with simple negotiation to enhance divisional cooperation for efficient work. We also investigate how this method can have high flexibility to adapt to change. We experimentally show that agents with our method generate several types of role sharing in a bottom-up manner for effective and flexible divisional cooperation. The results also show that agents using our method appropriately change their roles in different environmental change scenarios and enhance the overall efficiency and flexibility.

    AB - We propose a learning and negotiation method to enhance divisional cooperation and demonstrate its flexibility for adapting to environmental changes in the context of the multi-agent cooperative problem. We now have access to a vast array of information, and everything has become more closely connected. However, this makes tasks/problems in these environments complicated. In particular, we often require fast decision-making and flexible responses to follow environmental changes. For these requirements, multi-agent systems have been attracting interest, but the manner in which multiple agents cooperate is a challenging issue because of the computational cost, environmental complexity, and sophisticated interaction between agents. In this work, we address the continuous cooperative patrol problem, which requires cooperation based on high autonomy, and propose an autonomous learning method with simple negotiation to enhance divisional cooperation for efficient work. We also investigate how this method can have high flexibility to adapt to change. We experimentally show that agents with our method generate several types of role sharing in a bottom-up manner for effective and flexible divisional cooperation. The results also show that agents using our method appropriately change their roles in different environmental change scenarios and enhance the overall efficiency and flexibility.

    KW - Autonomous learning

    KW - Continuous patrolling

    KW - Divisional cooperation

    KW - Multi-agent system

    UR - http://www.scopus.com/inward/record.url?scp=85058373244&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85058373244&partnerID=8YFLogxK

    U2 - 10.1007/s10115-018-1285-8

    DO - 10.1007/s10115-018-1285-8

    M3 - Article

    JO - Knowledge and Information Systems

    JF - Knowledge and Information Systems

    SN - 0219-1377

    ER -