A PCA analysis of daily unwanted traffic

Kensuke Fukuda, Toshio Hirotsu, Osamu Akashi, Toshiharu Sugawara

Research output: Chapter in Book/Report/Conference proceedingConference contribution

8 Citations (Scopus)

Abstract

This paper investigates the macroscopic behavior of unwanted traffic (e.g., virus, worm, backscatter of (D)DoS or misconfiguration) passing through the Internet. The data set we used are unwanted packets measured at /18 darknet in Japan from Oct. 2006 to Apr. 2009 that included the recent Conficker outbreak. The traffic behavior is quantified by the entropy of ten packet features (e.g., 5-tuple). Then, we apply PCA (principal component analysis) to a ten dimensional entropy time series matrix to obtain a suitable representation of unwanted traffic. PCA is a well-known and studied method for finding out normal and anomalous behaviors in Internet backbone traffic, however, few studies applied it to darknet traffic. We first demonstrate the high variability nature of the entropy time series for ten packet features. Next, we show that the top four principal components are sufficiently enough to describe the original traffic behavior. In particular, the first component can be interpreted as the type of unwanted traffic (i.e., worm/virus or scanning), and the second one as the difference in communication patterns (e.g., one-to-many or many-to-one). Those two components account for 63.8% of the original data set in terms of the total variance. On the other hand, the outliers in the higher components indicate the presence of specific anomalies although most of mapped data to the components have less variability. Furthermore, we show that the scatter plot of the first and second principal component scores provides us with a better view of the macroscopic unwanted traffic behavior.

Original languageEnglish
Title of host publication24th IEEE International Conference on Advanced Information Networking and Applications, AINA 2010
Pages377-384
Number of pages8
DOIs
Publication statusPublished - 2010 Jul 12
Event24th IEEE International Conference on Advanced Information Networking and Applications, AINA2010 - Perth, WA, Australia
Duration: 2010 Apr 202010 Apr 23

Publication series

NameProceedings - International Conference on Advanced Information Networking and Applications, AINA
ISSN (Print)1550-445X

Conference

Conference24th IEEE International Conference on Advanced Information Networking and Applications, AINA2010
CountryAustralia
CityPerth, WA
Period10/4/2010/4/23

ASJC Scopus subject areas

  • Engineering(all)

Fingerprint Dive into the research topics of 'A PCA analysis of daily unwanted traffic'. Together they form a unique fingerprint.

  • Cite this

    Fukuda, K., Hirotsu, T., Akashi, O., & Sugawara, T. (2010). A PCA analysis of daily unwanted traffic. In 24th IEEE International Conference on Advanced Information Networking and Applications, AINA 2010 (pp. 377-384). [5474726] (Proceedings - International Conference on Advanced Information Networking and Applications, AINA). https://doi.org/10.1109/AINA.2010.79