Refining Fitness Functions for Search-Based Automated Program Repair - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2021

Refining Fitness Functions for Search-Based Automated Program Repair

Résumé

Automated Program Repair (APR) strives to automatically fix faulty software without human-intervention. Search-based APR iteratively generates possible patches for a buggy software, guided by the execution of the patched program on a test suite (i.e., a set of test cases). Search-based approaches have generally only used Boolean test case results (i.e., pass or fail), but recently more fined-grained fitness evaluations have been investigated with promising yet unsettled results. Using the most recent extension of the very popular Defects4J bug dataset, we conduct an empirical study using ARJA and ARJA-e, two state-ofthe-art search-based APR systems using a Boolean and a non-Boolean fitness function, respectively. We aim to both extend previous results using new bugs from Defects4J v2.0 and to settle whether refining the fitness function helps fixing bugs present in large software. In our experiments using 151 non-deprecated and not previously evaluated bugs from Defects4J v2.0, ARJA was able to find patches for 6.6% (10/151) of bugs, whereas ARJA-e found patches for 8% (12/151) of bugs. We thus observe only a small advantage in using the refined fitness function. This contrasts with the previous work using Defects4J v1.0.1 where ARJA was able to find adequate patches for 26.3% (59/224) of the bugs and ARJA-e for 47.3% (106/224). These results may indicate a potential overfitting of the tools towards the previous version of the Defects4J dataset.
Fichier principal
Vignette du fichier
guizzo_ssbse_2021.pdf (318.15 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04215729 , version 1 (22-09-2023)

Identifiants

Citer

Giovani Guizzo, Aymeric Blot, James Callan, Justyna Petke, Federica Sarro. Refining Fitness Functions for Search-Based Automated Program Repair: A Case Study with ARJA and ARJA-e. Symposium on Search-Based Software Engineering, Oct 2021, Bari, Italy. pp.159-165, ⟨10.1007/978-3-030-88106-1_12⟩. ⟨hal-04215729⟩
0 Consultations
3 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More