Litcius/Paper detail

Improving Data Generalization With Variational Autoencoders for Network Traffic Anomaly Detection

Mehrnoosh Monshizadeh, Vikramajeet Khatri, Marah Gamdou, Raimo Kantola, Zheng Yan

2021IEEE Access32 citationsDOIOpen Access PDF

Abstract

Deep generative models have increasingly become popular in different domains such as image processing, though, they hardly appear in the cybersecurity arena. While the main application of these models is dimensionality reduction, marginally they have been utilized for overcoming challenges such as data generalization and overfitting issues inherited from feature selection methods. To solve the mentioned challenges, we propose a combined architecture comprising a Conditional Variational AutoEncoder (CVAE) and a Random Forest (RF) classifier to automatically learn similarity among input features, provide data distribution in order to extract discriminative features from original features, and finally classify various types of attacks. CVAE introduces the labels of traffic packets into a latent space in order to better learn the changes of input samples and distinguish the data characteristics of each class. It avoids the confusion between classes while learning the whole data distribution. Compared with feature selection mechanisms such as Support Vector Machine Online (SVMo) by considering various evaluation metrics, the proposed architecture demonstrates considerable improvement in terms of performance. To verify the versatility of the proposed architecture, two publicly available datasets have been used in experiments.

Topics & Concepts

Computer scienceOverfittingDiscriminative modelAutoencoderArtificial intelligenceFeature selectionMachine learningPattern recognition (psychology)Feature vectorClassifier (UML)Data miningRandom forestSupport vector machineArtificial neural networkNetwork Security and Intrusion DetectionAnomaly Detection Techniques and ApplicationsInternet Traffic Analysis and Secure E-voting