Intelligent Small Object Detection Based on Digital Twinning for Smart Manufacturing in Industrial CPS

Xiaokang Zhou, Xuesong Xu, Wei Liang, Zhi Zeng, Shohei Shimizu, Laurence T. Yang, Qun Jin

Research output: Contribution to journalArticlepeer-review

Abstract

We focus on a small object detection model for digital twin, aiming to realize the dynamic synchronization between a physical manufacturing system and its virtual representation. Three significant elements, including equipment, product, and operator, are considered as the basic environmental parameters to represent and estimate the dynamic characteristics and real-time changes in building a generic DT system of smart manufacturing workshop. A hybrid deep neural network model based on the integration of MobileNet-v2, YOLOv4, and Openpose, is constructed to identify the real-time status from physical manufacturing environment to virtual space. A learning algorithm is then developed to realize the multi-type small object detection, in order to facilitate the modeling, monitoring, and optimizing of the whole smart manufacturing process in DT system. Experiments and evaluations using a real-world dataset demonstrate the effectiveness and usefulness of our proposed method which can achieve a higher detection accuracy for digital twinning in smart manufacturing.

Original languageEnglish
JournalIEEE Transactions on Industrial Informatics
DOIs
Publication statusAccepted/In press - 2021

Keywords

  • Data models
  • Deep Neural Network
  • Digital Twin
  • Feature extraction
  • Industrial CPS
  • Manufacturing
  • Manufacturing processes
  • Object detection
  • Object Detection
  • Posture Recognition
  • Real-time systems
  • Smart manufacturing

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Information Systems
  • Computer Science Applications
  • Electrical and Electronic Engineering

Fingerprint Dive into the research topics of 'Intelligent Small Object Detection Based on Digital Twinning for Smart Manufacturing in Industrial CPS'. Together they form a unique fingerprint.

Cite this