Forecasting HPC workload using ARMA models and SSA

Anoop S. Kumar, Somnath Mazumdar

Research output: Chapter in Book/Report/Conference proceedingArticle in proceedingsResearchpeer-review


In high-performance computing (HPC) platform, resource usage pattern changes over time which makes the resource monitoring a challenge. Maintaining the performance goals within a good power range is very critical where servers suffer from under utilisation, failure or degraded hardware support. Better forecast of the workload can reduce the energy cost by predicting the future workload more accurately. Identifying the usage pattern is also vital for efficient capacity planning because prediction can also be augmented with an effective resource allocation strategy to manage resource distribution goals. However, a single prediction model does not fit for all. In this paper, we compare forecast performance of the state-of-the-art ARMA class (integrated ARMA (ARIMA), seasonal integrated ARMA (SARIMA) and fractionally integrated ARMA (ARFIMA)) with the singular spectrum analysis (SSA) method using CPU, RAM and Network traces collected from Wikimedia grid. We found that the most simple model of ARMA class (ARIMA) had outperformed other complex ARMA class models while forecasting the bursty pattern of Networks. ARIMA model provides the best forecast for the Network data while SSA is found to be the best method for CPU and RAM. We also show that with proper model fitting, we can achieve high forecasting precision as low as 0.00586% for RAM and maximum error around 5% for Network without having complete information about the underlying system hardware and the running applications type.
Original languageEnglish
Title of host publicationProceedings - 2016 15th International Conference on Information Technology, ICIT 2016
Number of pages4
PublisherInstitute of Electrical and Electronics Engineers Inc.
Publication date30 Jun 2017
Article number7966851
ISBN (Electronic)9781509035847
Publication statusPublished - 30 Jun 2017
Externally publishedYes
Event15th International Conference on Information Technology, ICIT 2016 - Bhubaneswar, Odisha, India
Duration: 22 Dec 201624 Dec 2016
Conference number: 15


Conference15th International Conference on Information Technology, ICIT 2016
CityBhubaneswar, Odisha
SeriesProceedings - 2016 15th International Conference on Information Technology, ICIT 2016


  • HPC
  • Prediction
  • SSA
  • Time series

Cite this