Robust spread of cooperation by expectation-of-cooperation strategy with simple labeling method

Tomoaki Otsuka, Toshiharu Sugawara

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    2 Citations (Scopus)

    Abstract

    This paper proposes an interaction strategy called the extended expectation-of-cooperation (EEoC) that is intended to spread cooperative activities in prisoner's dilemma situations over an entire agent network. Recently developed computer and communications applications run on the network and interact with each other as delegates of the owners, so they often encounter social dilemma situations. To improve social efficiency, they are required to cooperate, but one-sided cooperation is meaningless and loses some payoff due to a rip-off by defecting agents. The concept of EEoC is that when agents encounter mutual cooperation, they continue to cooperate a few times with the desire to see the emergence of cooperative behavior in their neighbors. EEoC is easy to implement in computer systems.We experimentally show that EEoC can effectively spread cooperative activities in dilemma situations in complete, Erdös-Rényi, and regular networks. We also clarify the robustness against defecting agents and the limitation of the EEoC strategy.

    Original languageEnglish
    Title of host publicationProceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017
    PublisherAssociation for Computing Machinery, Inc
    Pages483-490
    Number of pages8
    ISBN (Electronic)9781450349512
    DOIs
    Publication statusPublished - 2017 Aug 23
    Event16th IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017 - Leipzig, Germany
    Duration: 2017 Aug 232017 Aug 26

    Other

    Other16th IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017
    CountryGermany
    CityLeipzig
    Period17/8/2317/8/26

    Fingerprint

    Labeling
    Computer systems
    Communication

    Keywords

    • Agent network
    • Cooperation
    • Prisoner's dilemma
    • Reinforcement learning

    ASJC Scopus subject areas

    • Computer Networks and Communications
    • Artificial Intelligence
    • Software

    Cite this

    Otsuka, T., & Sugawara, T. (2017). Robust spread of cooperation by expectation-of-cooperation strategy with simple labeling method. In Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017 (pp. 483-490). Association for Computing Machinery, Inc. https://doi.org/10.1145/3106426.3106458

    Robust spread of cooperation by expectation-of-cooperation strategy with simple labeling method. / Otsuka, Tomoaki; Sugawara, Toshiharu.

    Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017. Association for Computing Machinery, Inc, 2017. p. 483-490.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Otsuka, T & Sugawara, T 2017, Robust spread of cooperation by expectation-of-cooperation strategy with simple labeling method. in Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017. Association for Computing Machinery, Inc, pp. 483-490, 16th IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017, Leipzig, Germany, 17/8/23. https://doi.org/10.1145/3106426.3106458
    Otsuka T, Sugawara T. Robust spread of cooperation by expectation-of-cooperation strategy with simple labeling method. In Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017. Association for Computing Machinery, Inc. 2017. p. 483-490 https://doi.org/10.1145/3106426.3106458
    Otsuka, Tomoaki ; Sugawara, Toshiharu. / Robust spread of cooperation by expectation-of-cooperation strategy with simple labeling method. Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017. Association for Computing Machinery, Inc, 2017. pp. 483-490
    @inproceedings{c2c49688c0cf460c8c654424cfec0650,
    title = "Robust spread of cooperation by expectation-of-cooperation strategy with simple labeling method",
    abstract = "This paper proposes an interaction strategy called the extended expectation-of-cooperation (EEoC) that is intended to spread cooperative activities in prisoner's dilemma situations over an entire agent network. Recently developed computer and communications applications run on the network and interact with each other as delegates of the owners, so they often encounter social dilemma situations. To improve social efficiency, they are required to cooperate, but one-sided cooperation is meaningless and loses some payoff due to a rip-off by defecting agents. The concept of EEoC is that when agents encounter mutual cooperation, they continue to cooperate a few times with the desire to see the emergence of cooperative behavior in their neighbors. EEoC is easy to implement in computer systems.We experimentally show that EEoC can effectively spread cooperative activities in dilemma situations in complete, Erd{\"o}s-R{\'e}nyi, and regular networks. We also clarify the robustness against defecting agents and the limitation of the EEoC strategy.",
    keywords = "Agent network, Cooperation, Prisoner's dilemma, Reinforcement learning",
    author = "Tomoaki Otsuka and Toshiharu Sugawara",
    year = "2017",
    month = "8",
    day = "23",
    doi = "10.1145/3106426.3106458",
    language = "English",
    pages = "483--490",
    booktitle = "Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017",
    publisher = "Association for Computing Machinery, Inc",

    }

    TY - GEN

    T1 - Robust spread of cooperation by expectation-of-cooperation strategy with simple labeling method

    AU - Otsuka, Tomoaki

    AU - Sugawara, Toshiharu

    PY - 2017/8/23

    Y1 - 2017/8/23

    N2 - This paper proposes an interaction strategy called the extended expectation-of-cooperation (EEoC) that is intended to spread cooperative activities in prisoner's dilemma situations over an entire agent network. Recently developed computer and communications applications run on the network and interact with each other as delegates of the owners, so they often encounter social dilemma situations. To improve social efficiency, they are required to cooperate, but one-sided cooperation is meaningless and loses some payoff due to a rip-off by defecting agents. The concept of EEoC is that when agents encounter mutual cooperation, they continue to cooperate a few times with the desire to see the emergence of cooperative behavior in their neighbors. EEoC is easy to implement in computer systems.We experimentally show that EEoC can effectively spread cooperative activities in dilemma situations in complete, Erdös-Rényi, and regular networks. We also clarify the robustness against defecting agents and the limitation of the EEoC strategy.

    AB - This paper proposes an interaction strategy called the extended expectation-of-cooperation (EEoC) that is intended to spread cooperative activities in prisoner's dilemma situations over an entire agent network. Recently developed computer and communications applications run on the network and interact with each other as delegates of the owners, so they often encounter social dilemma situations. To improve social efficiency, they are required to cooperate, but one-sided cooperation is meaningless and loses some payoff due to a rip-off by defecting agents. The concept of EEoC is that when agents encounter mutual cooperation, they continue to cooperate a few times with the desire to see the emergence of cooperative behavior in their neighbors. EEoC is easy to implement in computer systems.We experimentally show that EEoC can effectively spread cooperative activities in dilemma situations in complete, Erdös-Rényi, and regular networks. We also clarify the robustness against defecting agents and the limitation of the EEoC strategy.

    KW - Agent network

    KW - Cooperation

    KW - Prisoner's dilemma

    KW - Reinforcement learning

    UR - http://www.scopus.com/inward/record.url?scp=85030995624&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=85030995624&partnerID=8YFLogxK

    U2 - 10.1145/3106426.3106458

    DO - 10.1145/3106426.3106458

    M3 - Conference contribution

    SP - 483

    EP - 490

    BT - Proceedings - 2017 IEEE/WIC/ACM International Conference on Web Intelligence, WI 2017

    PB - Association for Computing Machinery, Inc

    ER -