Article Dans Une Revue Proceedings of the ACM on Software Engineering Année : 2025

What Happened in This Pipeline? Diffing Build Logs with CiDiff

Résumé

Continuous integration (CI) is widely used by developers to ensure the quality and reliability of their software projects. However, diagnosing a CI regression is a tedious process that involves the manual analysis of lengthy build logs. In this paper, we explore how textual differencing can support the debugging of CI regressions. As off-the-shelf diff algorithms produce suboptimal results, in this work we introduce a new diff algorithm specifically tailored to build logs called CiDiff. We evaluate CiDiff against several baselines on a novel dataset of 17 906 CI regressions, performing an accuracy study, a quantitative study and a user-study. Notably, our algorithm reduces the number of lines to inspect by about 60 % in the median case, with reasonable overhead compared to the state-of-practice LCS-diff. Finally, our algorithm is preferred by the majority of participants in 70 % of the regression cases, whereas LCS-diff is preferred in only 5 % of the cases.

Fichier principal
Vignette du fichier
ISSTA_25___CiDiff.pdf (669.61 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence
DOI

Est complété par 10.5281/zenodo.15527909 Article Hubner, N., & Falleri-Vialard, J.-R. (2025). CiDiff Artifact. Zenodo. https://doi.org/10.5281/ZENODO.15527909

Dates et versions

hal-05035587 , version 1 (24-04-2025)

Licence

Identifiants

Citer

Nicolas Hubner, Jean-Rémy Falleri, Raluca Uricaru, Thomas Degueule, Thomas Durieux. What Happened in This Pipeline? Diffing Build Logs with CiDiff. Proceedings of the ACM on Software Engineering, 2025, 2 (ISSTA), pp.2023-2044. ⟨10.1145/3728966⟩. ⟨hal-05035587⟩
239 Consultations
398 Téléchargements

Altmetric

Partager

  • More