Efficient team formation based on learning and reorganization and influence of communication delay

Ryota Katayanagi, Toshiharu Sugawara

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    11 Citations (Scopus)

    Abstract

    We propose a method of distributed team formation that uses reinforcement learning and dynamic reorganization by taking into account communication delay in multiagent systems (MAS). A task in a distributed environment is usually achieved by doing a number of subtasks that require different functions and resources. These subtasks have to be processed cooperatively in the appropriate team of agents that have the required functions with sufficient resources, but it is difficult to anticipate what kinds of tasks will be requested in the dynamic and open environment during the design stage of the system. It is also unknown whether or not their inter-agent network (that is, the organization of agents) is appropriate to form teams for the given tasks. In addition, communication delay between the agents always occurs in the actual systems, and this often causes a failure or delay of tasks. Therefore, both appropriate team formation and (re)organization suitable for the request patterns of incoming tasks and the environment where agents are deployed are required. The proposed method combines the learning for team formation and reorganization in a way that is adaptive to the environment. This includes task generation patterns and communication delay that may change dynamically. We show that it can improve the overall performance and increase the success rate of team formation in a dynamic environment.

    Original languageEnglish
    Title of host publicationProceedings - 11th IEEE International Conference on Computer and Information Technology, CIT 2011
    Pages563-570
    Number of pages8
    DOIs
    Publication statusPublished - 2011
    Event11th IEEE International Conference on Computer and Information Technology, CIT 2011 and 11th IEEE International Conference on Scalable Computing and Communications, SCALCOM 2011 - Pafos
    Duration: 2011 Aug 312011 Sep 2

    Other

    Other11th IEEE International Conference on Computer and Information Technology, CIT 2011 and 11th IEEE International Conference on Scalable Computing and Communications, SCALCOM 2011
    CityPafos
    Period11/8/3111/9/2

    Fingerprint

    Communication
    Reinforcement learning
    Multi agent systems

    Keywords

    • Multi-agent system
    • Reinforcement learning
    • Reorganization
    • Team formation

    ASJC Scopus subject areas

    • Computer Networks and Communications
    • Information Systems

    Cite this

    Katayanagi, R., & Sugawara, T. (2011). Efficient team formation based on learning and reorganization and influence of communication delay. In Proceedings - 11th IEEE International Conference on Computer and Information Technology, CIT 2011 (pp. 563-570). [6036826] https://doi.org/10.1109/CIT.2011.18

    Efficient team formation based on learning and reorganization and influence of communication delay. / Katayanagi, Ryota; Sugawara, Toshiharu.

    Proceedings - 11th IEEE International Conference on Computer and Information Technology, CIT 2011. 2011. p. 563-570 6036826.

    Research output: Chapter in Book/Report/Conference proceedingConference contribution

    Katayanagi, R & Sugawara, T 2011, Efficient team formation based on learning and reorganization and influence of communication delay. in Proceedings - 11th IEEE International Conference on Computer and Information Technology, CIT 2011., 6036826, pp. 563-570, 11th IEEE International Conference on Computer and Information Technology, CIT 2011 and 11th IEEE International Conference on Scalable Computing and Communications, SCALCOM 2011, Pafos, 11/8/31. https://doi.org/10.1109/CIT.2011.18
    Katayanagi R, Sugawara T. Efficient team formation based on learning and reorganization and influence of communication delay. In Proceedings - 11th IEEE International Conference on Computer and Information Technology, CIT 2011. 2011. p. 563-570. 6036826 https://doi.org/10.1109/CIT.2011.18
    Katayanagi, Ryota ; Sugawara, Toshiharu. / Efficient team formation based on learning and reorganization and influence of communication delay. Proceedings - 11th IEEE International Conference on Computer and Information Technology, CIT 2011. 2011. pp. 563-570
    @inproceedings{c40ad2225df54789b8fa7e67f7966de4,
    title = "Efficient team formation based on learning and reorganization and influence of communication delay",
    abstract = "We propose a method of distributed team formation that uses reinforcement learning and dynamic reorganization by taking into account communication delay in multiagent systems (MAS). A task in a distributed environment is usually achieved by doing a number of subtasks that require different functions and resources. These subtasks have to be processed cooperatively in the appropriate team of agents that have the required functions with sufficient resources, but it is difficult to anticipate what kinds of tasks will be requested in the dynamic and open environment during the design stage of the system. It is also unknown whether or not their inter-agent network (that is, the organization of agents) is appropriate to form teams for the given tasks. In addition, communication delay between the agents always occurs in the actual systems, and this often causes a failure or delay of tasks. Therefore, both appropriate team formation and (re)organization suitable for the request patterns of incoming tasks and the environment where agents are deployed are required. The proposed method combines the learning for team formation and reorganization in a way that is adaptive to the environment. This includes task generation patterns and communication delay that may change dynamically. We show that it can improve the overall performance and increase the success rate of team formation in a dynamic environment.",
    keywords = "Multi-agent system, Reinforcement learning, Reorganization, Team formation",
    author = "Ryota Katayanagi and Toshiharu Sugawara",
    year = "2011",
    doi = "10.1109/CIT.2011.18",
    language = "English",
    isbn = "9780769543888",
    pages = "563--570",
    booktitle = "Proceedings - 11th IEEE International Conference on Computer and Information Technology, CIT 2011",

    }

    TY - GEN

    T1 - Efficient team formation based on learning and reorganization and influence of communication delay

    AU - Katayanagi, Ryota

    AU - Sugawara, Toshiharu

    PY - 2011

    Y1 - 2011

    N2 - We propose a method of distributed team formation that uses reinforcement learning and dynamic reorganization by taking into account communication delay in multiagent systems (MAS). A task in a distributed environment is usually achieved by doing a number of subtasks that require different functions and resources. These subtasks have to be processed cooperatively in the appropriate team of agents that have the required functions with sufficient resources, but it is difficult to anticipate what kinds of tasks will be requested in the dynamic and open environment during the design stage of the system. It is also unknown whether or not their inter-agent network (that is, the organization of agents) is appropriate to form teams for the given tasks. In addition, communication delay between the agents always occurs in the actual systems, and this often causes a failure or delay of tasks. Therefore, both appropriate team formation and (re)organization suitable for the request patterns of incoming tasks and the environment where agents are deployed are required. The proposed method combines the learning for team formation and reorganization in a way that is adaptive to the environment. This includes task generation patterns and communication delay that may change dynamically. We show that it can improve the overall performance and increase the success rate of team formation in a dynamic environment.

    AB - We propose a method of distributed team formation that uses reinforcement learning and dynamic reorganization by taking into account communication delay in multiagent systems (MAS). A task in a distributed environment is usually achieved by doing a number of subtasks that require different functions and resources. These subtasks have to be processed cooperatively in the appropriate team of agents that have the required functions with sufficient resources, but it is difficult to anticipate what kinds of tasks will be requested in the dynamic and open environment during the design stage of the system. It is also unknown whether or not their inter-agent network (that is, the organization of agents) is appropriate to form teams for the given tasks. In addition, communication delay between the agents always occurs in the actual systems, and this often causes a failure or delay of tasks. Therefore, both appropriate team formation and (re)organization suitable for the request patterns of incoming tasks and the environment where agents are deployed are required. The proposed method combines the learning for team formation and reorganization in a way that is adaptive to the environment. This includes task generation patterns and communication delay that may change dynamically. We show that it can improve the overall performance and increase the success rate of team formation in a dynamic environment.

    KW - Multi-agent system

    KW - Reinforcement learning

    KW - Reorganization

    KW - Team formation

    UR - http://www.scopus.com/inward/record.url?scp=80054967308&partnerID=8YFLogxK

    UR - http://www.scopus.com/inward/citedby.url?scp=80054967308&partnerID=8YFLogxK

    U2 - 10.1109/CIT.2011.18

    DO - 10.1109/CIT.2011.18

    M3 - Conference contribution

    SN - 9780769543888

    SP - 563

    EP - 570

    BT - Proceedings - 11th IEEE International Conference on Computer and Information Technology, CIT 2011

    ER -