Network failure detection and diagnosis by analyzing Syslog and SNS data: Applying big data analysis to network operations

Tatsuaki Kimura, Kei Takeshita, Tsuyoshi Toyono, Masahiro Yokota, Ken Nishimatsu, Tatsuya Mori

Research output: Contribution to journalReview article

3 Citations (Scopus)


We introduce two big data analysis methods for diagnosing the causes of network failures and for detecting network failures early Syslogs contain log data generated by the system. We analyzed syslogs and succeeded in detecting the cause of a network failure by automatically learning over 100 million logs without needing any previous knowledge of log data. Analysis of the data of a social networking service (namely, Twitter) enabled us to detect possible network failures by extracting network-failure related tweets, which account for less than 1% of all tweets, in real time and with high accuracy.

Original languageEnglish
JournalNTT Technical Review
Issue number11
Publication statusPublished - 2013 Nov 1



  • Big data
  • Network failure detection
  • Syslog

ASJC Scopus subject areas

  • Computer Science Applications
  • Computer Networks and Communications
  • Electrical and Electronic Engineering

Cite this