From Coverage Computation to Fault Localization: A Generic Framework for Domain-Specific Languages - Archive ouverte HAL
Communication Dans Un Congrès Année : 2022

From Coverage Computation to Fault Localization: A Generic Framework for Domain-Specific Languages

Résumé

To test a system efficiently, we need to know how good are the defined test cases and to localize detected faults in the system. Measuring test coverage can address both concerns as it is a popular metric for test quality evaluation and, at the same time, is the foundation of advanced fault localization techniques. However, for Domain-Specific Languages (DSLs), coverage metrics and associated tools are usually manually defined for each DSL representing costly, error-prone, and non-reusable work. To address this problem, we propose a generic coverage computation and fault localization framework for DSLs. Considering a test suite executed on a model conforming to a DSL, we compute a coverage matrix based on three ingredients: the DSL specification, the coverage rules, and the model's execution trace. Using the test execution result and the computed coverage matrix, the framework calculates the suspiciousness-based ranking of the model's elements based on existing spectrum-based techniques to help the user in localizing the model's faults. We provide a tool atop the Eclipse GEMOC Studio and evaluate our approach using four different DSLs, with 297 test cases for 21 models in total.
Fichier principal
Vignette du fichier
main-CR-authorVersion.pdf (10.2 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03815772 , version 1 (17-10-2022)

Identifiants

Citer

Faezeh Khorram, Erwan Bousse, Antonio Garmendia, Jean-Marie Mottu, Gerson Sunyé, et al.. From Coverage Computation to Fault Localization: A Generic Framework for Domain-Specific Languages. SLE 2022: 15th ACM SIGPLAN International Conference on Software Language Engineering, Dec 2022, Auckland, New Zealand. pp.235-248, ⟨10.1145/3567512.3567532⟩. ⟨hal-03815772⟩
292 Consultations
114 Téléchargements

Altmetric

Partager

More