Learning input-aware performance models of configurable systems: An empirical evaluation - Archive ouverte HAL
Journal Articles Journal of Systems and Software Year : 2023

Learning input-aware performance models of configurable systems: An empirical evaluation

Abstract

Modern software-based systems are highly configurable and come with a number of configuration options that impact the performance of the systems. However, selecting inappropriate values for these options can cause long response time, high CPU load, downtime, RAM exhaustion, resulting in performance degradation and poor software reliability. Consequently, considerable effort has been carried out to predict key performance metrics (execution time, program size, energy consumption, etc.) from the user's choice of configuration options values. The selection of inputs (e.g., JavaScript scripts embedded in a web page interpreted by Node.js or input videos encoded with x264 by a streaming platform) also impacts software performance, and there is a complex interplay between inputs and configurations. Unfortunately, owing to the huge variety of existing inputs, it is yet challenging to automate the prediction of software performance whatever their configuration and input. In this article, we empirically evaluate how supervised and transfer learning methods can be leveraged to efficiently learn performance models based on configuration options and input data. Our study over 1,941,075 data points empirically shows that measuring the performance of configurations on multiple inputs allows one to reuse this knowledge and train performance models robust to the change of input data. To the best of our knowledge, this is the first domain-agnostic empirical evaluation of machine learning methods addressing the input-aware performance prediction problem.
Fichier principal
Vignette du fichier
JSS_2023___Data_efficient_performance_model-preprint.pdf (3.11 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04271476 , version 1 (06-11-2023)

Licence

Identifiers

Cite

Luc Lesoil, Helge Spieker, Arnaud Gotlieb, Mathieu Acher, Paul Temple, et al.. Learning input-aware performance models of configurable systems: An empirical evaluation. Journal of Systems and Software, 2023, pp.111883. ⟨10.1016/j.jss.2023.111883⟩. ⟨hal-04271476⟩
133 View
121 Download

Altmetric

Share

More