Beware of the Interactions of Variability Layers When Reasoning about Evolution of MongoDB - Archive ouverte HAL Access content directly
Conference Papers Year : 2022

Beware of the Interactions of Variability Layers When Reasoning about Evolution of MongoDB

Abstract

With commits and releases, hundreds of tests are run on varying conditions (e.g., over different hardware and workloads) that can help to understand evolution and ensure non-regression of software performance. We hypothesize that performance is not only sensitive to evolution of software, but also to different variability layers of its execution environment, spanning the hardware, the operating system, the build, or the workload processed by the software. Leveraging the MongoDB dataset, our results show that changes in hardware and workload can drastically impact performance evolution and thus should be taken into account when reasoning about evolution. An open problem resulting from this study is how to manage the variability layers in order to efficiently test the performance evolution of a software.
Fichier principal
Vignette du fichier
ICPE_2022___Data_challenge.pdf (2.65 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03624309 , version 1 (30-03-2022)

Licence

Attribution

Identifiers

Cite

Luc Lesoil, Mathieu Acher, Arnaud Blouin, Jean-Marc Jézéquel. Beware of the Interactions of Variability Layers When Reasoning about Evolution of MongoDB. ICPE 2022 - 13th ACM/SPEC International Conference on Performance Engineering, Apr 2022, Beijing, China. pp.1-5, ⟨10.1145/3491204.3527489⟩. ⟨hal-03624309⟩
201 View
82 Download

Altmetric

Share

Gmail Facebook X LinkedIn More