Forecasting Data Center Resource Usage: An Experimental Comparison with Time-series Methods

Somnath Mazumdar, Anoop S. Kumar*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review

Abstract

Capacity planning via resource monitoring in data centers (DCs) is a challenge. The computing resource usage pattern changes over the time which makes its management a complex process. Maintaining system’s performance (or service) goals together with infrastructure management cost in a limit, are very critical. Despite various control measures, still, resources suffer from under utilisation. To alleviate such problems, we need a proactive resource management framework which combines the prediction of the future workload together with the efficient resource allocation strategy. In this paper, we focus on the prediction problem and compare the forecasting efficacy of the well-known time series prediction models by performing an exhaustive experimental campaign on the real workload traces collected from Wikimedia Grid. In this work, first, we compare popular variants of autoregressive moving average (ARMA) models (such as integrated, fractional, seasonal) with two different approaches namely the exponential smoothing model (Holt-Winters) and spectral estimation method (singular spectrum analysis (SSA)). Next, to increase the efficiency of the forecasting capability of the ARMA variants, we add Kalman filter and also Wavelet decomposition. Finally, we report all the results together with detailed explanations and execution time. In experiments, we observe that Kalman filter based ARIMA and its seasonal variants outperform others. These hybrid models also achieve a very high quality of forecasting accuracy (mean absolute percentage error (MAPE) such as it is less than 0.03% for RAM, under 0.8% for CPU and less than 4% for Network), while the complete system knowledge is not known to us. We also found that for one-hour out-sample prediction input size of fifteen and thirty days are enough to get very good results.

Original languageEnglish
Title of host publicationProceedings of the Eighth International Conference on Soft Computing and Pattern Recognition. SoCPaR 2016
EditorsAna Maria Madureira, Aswani Kumar Cherukuri, Ajith Abraham, Azah Kamilah Muda
Number of pages15
Place of PublicationCham
PublisherSpringer
Publication date2018
Pages151-165
ISBN (Print)9783319606170
ISBN (Electronic)9783319606187
DOIs
Publication statusPublished - 2018
Externally publishedYes
Event8th International Conference on Soft Computing and Pattern Recognition, SoCPaR 2016 - Vellore, India
Duration: 19 Dec 201621 Dec 2016
Conference number: 8

Conference

Conference8th International Conference on Soft Computing and Pattern Recognition, SoCPaR 2016
Number8
Country/TerritoryIndia
CityVellore
Period19/12/201621/12/2016
SeriesAdvances in Intelligent Systems and Computing
Volume614
ISSN2194-5357

Keywords

  • ARMA
  • Forecasting
  • Fractional
  • Integrated
  • Kalman filter
  • Seasonal
  • SSA
  • Time series
  • Wavelet

Cite this