Promotion of robust cooperation among agents in complex networks by enhanced expectation-of-cooperation strategy

Tomoaki Otsuka, Toshiharu Sugawara

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Abstract

    We present an interaction strategy with reinforcement learning to promote mutual cooperation among agents in complex networks. Networked computerized systems consisting of many agents that are delegates of social entities, such as companies and organizations, are being implemented due to advances in networking and computer technologies. Because the relationships among agents reflect the interaction structures of the corresponding social entities in the real world, social dilemma situations like the prisoner’s dilemma are often encountered. Thus, agents have to learn appropriate behaviors from the long term viewpoint to be able to function properly in the virtual society. The proposed interaction strategy is called the enhanced expectation-of-cooperation (EEoC) strategy and is an extension of our previously proposed strategy for improving robustness against defecting agents and for preventing exploitation by them. Experiments demonstrated that agents using the EEoC strategy can effectively distinguish cooperative neighboring agents from all-defecting (AllD) agents and thus can spread cooperation among EEoC agents and avoid being exploited by AllD agents. Examination of robustness against probabilistically defecting (ProbD) agents demonstrated that EEoC agents can spread and maintain mutual cooperation if the number of ProbD agents is not large. The EEoC strategy is thus simple and useful in actual computerized systems.

    Original languageEnglish
    Title of host publicationComplex Networks and Their Applications VI - Proceedings of Complex Networks 2017 (The 6th International Conference on Complex Networks and Their Applications)
    PublisherSpringer-Verlag
    Pages815-828
    Number of pages14
    ISBN (Print)9783319721491
    DOIs
    Publication statusPublished - 2018 Jan 1
    Event6th International Conference on Complex Networks and Their Applications, Complex Networks 2017 - Lyon, France
    Duration: 2017 Nov 292017 Dec 1

    Publication series

    NameStudies in Computational Intelligence
    Volume689
    ISSN (Print)1860-949X

    Other

    Other6th International Conference on Complex Networks and Their Applications, Complex Networks 2017
    CountryFrance
    CityLyon
    Period17/11/2917/12/1

      Fingerprint

    ASJC Scopus subject areas

    • Artificial Intelligence

    Cite this

    Otsuka, T., & Sugawara, T. (2018). Promotion of robust cooperation among agents in complex networks by enhanced expectation-of-cooperation strategy. In Complex Networks and Their Applications VI - Proceedings of Complex Networks 2017 (The 6th International Conference on Complex Networks and Their Applications) (pp. 815-828). (Studies in Computational Intelligence; Vol. 689). Springer-Verlag. https://doi.org/10.1007/978-3-319-72150-7_66