Deep-Reinforcement-Learning-Based Cybertwin Architecture for 6G IIoT: An Integrated Design of Control, Communication, and Computing

Hansong Xu, Jun Wu, Jianhua Li, Xi Lin*


研究成果: Article査読

10 被引用数 (Scopus)


The cybertwin and 6G-enabled Industrial Internet of Things (6G-IIoT) are the critical technologies that create the digital counterparts for physical systems and enable the near-instant interconnectivity in the industrial domain. It is in demand but challenging to conduct the integrated design for 6G-IIoT, which intertwines the cyber subsystems, such as control, communication, computing (3C), and the physical industrial factories and plants. Therefore, the cybertwin, which synchronizes between the digital counterparts and its physical entities during the system runtime, is the ideal proving ground for conducting the integrated design on the highly intertwined 3C of 6G-IIoT. However, the cybertwin lacks artificial intelligence to capacitate the automated integrated design for the 6G-IIoT. In this article, we first demonstrate the architecture of the machine-learning-based cybertwin for 6G-IIoT. Then, we leverage deep reinforcement learning (DRL) to conduct the integrated design via systematic trial and error in the cybertwin model, which is otherwise costly and dangerous in real industrial systems. Moreover, we invent the adaptive observation window for deep Q -network (AOW-DQN), which generates system states adaptive to the control system's physical dynamics. Finally, the experimental results demonstrate the effectiveness and efficiency of our approach. To the best of our knowledge, we are the first to present the machine-learning-based cybertwin for carrying out the integrated design on the 3C for 6G-IIoT.

ジャーナルIEEE Internet of Things Journal
出版ステータスPublished - 2021 11月 15

ASJC Scopus subject areas

  • 信号処理
  • 情報システム
  • ハードウェアとアーキテクチャ
  • コンピュータ サイエンスの応用
  • コンピュータ ネットワークおよび通信


「Deep-Reinforcement-Learning-Based Cybertwin Architecture for 6G IIoT: An Integrated Design of Control, Communication, and Computing」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。