MARL Based Cooperative Passive Beamforming Design for Multi-IRS Aided Networks

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Intelligent Reflecting Surface (IRS) is a planar surface that allows the signal transmission to be artificially manipulated. Communication aided by multiple IRSs is proven to be more effective in aspects such as transmission rate and signal coverage, but it raises complex coordination in issues such as channel estimation, resource allocation, and active/passive beamforming design problems for the Base Station (BS), IRSs and User Equipments (UEs). In this paper, we discuss the cooperative passive beamforming problem for multiple IRSs. First, we develop a multi-user communication scenario, in which multiple discrete phase shift IRSs are deployed to assist the transmission. Then, we formulate the cooperative passive beam-forming problem to maximize the sum transmission rate within a cellular multi-user network. To address this problem, we discuss a Reinforcement Learning (RL) approach, i.e., to transform the problem into a Multi-agent Markov Decision Process (MA MDP) and raise a Q-learning-based solution. Three different designs of the reward function are tested. Simulation results regarding the performance under different IRS and RL settings are given, which show that the proposed algorithm is capable of reaching a favorable passive beamforming solution in limited iterations and is effective in both convergence and long-term performance.

Original languageEnglish
Title of host publication2022 IEEE 33rd Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2022
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages397-402
Number of pages6
ISBN (Electronic)9781665480536
DOIs
Publication statusPublished - 2022
Event33rd IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2022 - Virtual, Online, Japan
Duration: 2022 Sep 122022 Sep 15

Publication series

NameIEEE International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC
Volume2022-September

Conference

Conference33rd IEEE Annual International Symposium on Personal, Indoor and Mobile Radio Communications, PIMRC 2022
Country/TerritoryJapan
CityVirtual, Online
Period22/9/1222/9/15

Keywords

  • discrete value passive beamforming
  • Intelligent reflecting surface
  • multi-agent systems
  • reinforcement learning

ASJC Scopus subject areas

  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'MARL Based Cooperative Passive Beamforming Design for Multi-IRS Aided Networks'. Together they form a unique fingerprint.

Cite this