A Big Data Management Architecture for Standardized IoT Based on Smart Scalable SNMP

Wentao Zhang, Mianxiong Dong, Kaoru Ota, Jianhua Li, Wu Yang, Jun Wu

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Abstract

Standardization facilitates the management of Internet of Things (IoT) and expedites the generation of IoT big data. However, there is not yet a big data management architecture matching such IoT. Current methodologies, which mainly adopts Simple Network Management Protocol (SNMP), is defective in the following two aspects. First, facing ubiquitous sensor and actuator nodes, timeliness and scalability can hardly be assured by the centralized paradigm. Second, existing management infrastructure cannot perform data analysis and is thus not smart enough, which wastes the value of big data. To address these issues, we propose a big data management architecture for standardized IoT. First, we design a scalable and smart SNMP, which has a hierarchical and decentralized paradigm, and is embedded with edge MapReduce to perform distributed big data analysis. Second, we put forward an Edge MapReduce-based Random Matrix Model (RMM) algorithm for anomaly detection in IoT, which is parallelized and particularly suitable for high-dimensional big data. Third, we conduct a case study of smart grids, where the architecture is implemented using virtual machines and deployed to detect malfunctions in electrical grids. Experiment results demonstrate that the architecture has good performance in terms of timeliness and scalability.

Original languageEnglish
Title of host publication2020 IEEE International Conference on Communications, ICC 2020 - Proceedings
PublisherInstitute of Electrical and Electronics Engineers Inc.
ISBN (Electronic)9781728150895
DOIs
Publication statusPublished - 2020 Jun
Externally publishedYes
Event2020 IEEE International Conference on Communications, ICC 2020 - Dublin, Ireland
Duration: 2020 Jun 72020 Jun 11

Publication series

NameIEEE International Conference on Communications
Volume2020-June
ISSN (Print)1550-3607

Conference

Conference2020 IEEE International Conference on Communications, ICC 2020
Country/TerritoryIreland
CityDublin
Period20/6/720/6/11

Keywords

  • big data
  • edge computing
  • IoT
  • MapReduce
  • SNMP
  • standardization

ASJC Scopus subject areas

  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Fingerprint

Dive into the research topics of 'A Big Data Management Architecture for Standardized IoT Based on Smart Scalable SNMP'. Together they form a unique fingerprint.

Cite this