Deep Learning Models For Aggregated Network Traffic Prediction

The ability to generate network traffic predictions at short time scales is crucial for many network management tasks such as traffic engineering, anomaly detection, and traffic matrix estimation. However, building models that are able to predict the traffic from modern networks at short time scales is not a trivial task due to the diversity of the network traffic sources. In this paper, we present a framework for network-wide link-level traffic prediction using Long Short-Term Memory (LSTM) neural networks. Our proposed framework leverages link statistics that can be easily collected either by the controller of a Software Defined Network (SDN), or by SNMP measurements in a legacy network, in order to predict future link throughputs. We implement several variations of LSTMs and compare their performance with traditional baseline models. Our evaluation study using real network traces from a Tier-1 ISP illustrates that LSTMs can predict link throughputs with very high accuracy outperforming the baselines for various traffic aggregation levels and time scales.

[1]  San-qi Li,et al.  A predictability analysis of network traffic , 2002, Comput. Networks.

[2]  Zhi-Li Zhang,et al.  Profiling internet backbone traffic: behavior models and applications , 2005, SIGCOMM '05.

[3]  Qian Xu,et al.  MS-LSTM: A multi-scale LSTM model for BGP anomaly detection , 2016, 2016 IEEE 24th International Conference on Network Protocols (ICNP).

[4]  Steve Uhlig,et al.  Providing public intradomain traffic matrices to the research community , 2006, CCRV.

[5]  Amarnath Mukherjee,et al.  Time series models for internet traffic , 1996, Proceedings of IEEE INFOCOM '96. Conference on Computer Communications.

[6]  Ming Zhang,et al.  MicroTE: fine grained traffic engineering for data centers , 2011, CoNEXT '11.

[7]  Jürgen Schmidhuber,et al.  Long Short-Term Memory , 1997, Neural Computation.

[8]  Yusheng Ji,et al.  Deep Convolutional LSTM Network-based Traffic Matrix Prediction with Partial Information , 2019, 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM).

[9]  Robert H. Shumway,et al.  Time Series Analysis and Its Applications (Springer Texts in Statistics) , 2005 .

[10]  Abdulsalam Yassine,et al.  Software defined network traffic measurement: Current trends and challenges , 2015, IEEE Instrumentation & Measurement Magazine.

[11]  Viktor K. Prasanna,et al.  An LSTM Framework For Modeling Network Traffic , 2019, 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM).

[12]  Min Zhu,et al.  B4: experience with a globally-deployed software defined wan , 2013, SIGCOMM.

[13]  Viktor K. Prasanna,et al.  DeepFlow: a deep learning framework for software-defined measurement , 2017, CAN@CoNEXT.

[14]  Jean C. Walrand,et al.  Knowledge-Defined Networking , 2016, Comput. Commun. Rev..

[15]  Ying Chen,et al.  Anomaly Detection Using LSTM in IP Networks , 2018, 2018 Sixth International Conference on Advanced Cloud and Big Data (CBD).

[16]  Mikkel Thorup,et al.  Traffic engineering with estimated traffic matrices , 2003, IMC '03.

[17]  Kavitha Chandra,et al.  Time series models for Internet data traffic , 1999, Proceedings 24th Conference on Local Computer Networks. LCN'99.

[18]  Sujata Banerjee,et al.  DevoFlow: scaling flow management for high-performance networks , 2011, SIGCOMM 2011.

[19]  Tarun Soni,et al.  Network Traffic Prediction Using Recurrent Neural Networks , 2018, 2018 17th IEEE International Conference on Machine Learning and Applications (ICMLA).

[20]  Geoffrey E. Hinton,et al.  Deep Learning , 2015, Nature.

[21]  Konstantina Papagiannaki,et al.  Long-term forecasting of Internet backbone traffic: observations and initial models , 2003, IEEE INFOCOM 2003. Twenty-second Annual Joint Conference of the IEEE Computer and Communications Societies (IEEE Cat. No.03CH37428).

[22]  Guy Pujolle,et al.  NeuTM: A neural network-based framework for traffic matrix prediction in SDN , 2017, NOMS 2018 - 2018 IEEE/IFIP Network Operations and Management Symposium.

[23]  Kavé Salamatian,et al.  Combining filtering and statistical methods for anomaly detection , 2005, IMC '05.

[24]  Matthew Roughan,et al.  Internet Traffic Matrices: A Primer , 2013 .

[25]  Philippe Owezarski,et al.  Modeling Internet backbone traffic at the flow level , 2003, IEEE Trans. Signal Process..

[26]  Yoshua Bengio,et al.  Random Search for Hyper-Parameter Optimization , 2012, J. Mach. Learn. Res..