A language-parametric test coverage framework for executable domain-specific languages - Archive ouverte HAL
Article Dans Une Revue Journal of Systems and Software Année : 2024

A language-parametric test coverage framework for executable domain-specific languages

Résumé

Test coverage is an effective technique to measure test case quality and to enable fault localization. However, for Executable Domain-Specific Languages (xDSLs), coverage metrics and associated tools are currently manually defined for each xDSL resulting in costly, error-prone, and non-reusable work. To address this problem, we propose a novel language-parametric test coverage framework for xDSLs. We define two coverage metrics adapted to xDSLs: model element and branch coverage. For performing coverage measurements, we propose a generic technique which can be used out-of-the-box by domain experts using any xDSL to define, execute, and test models. In addition, the coverage of model elements and branches can be parameterized for a given xDSL through the definition of coverage rules using a dedicated language. We showcase two test coverage applications for xDSLs: measuring the quality of test suites for executable models and localizing the models' faults using Spectrum-Based Fault Localization techniques. We evaluate our approach using four different xDSLs. Results show that (i) we can generate meaningful coverage measurements for all investigated models, (ii) the provided coverage rule language enables framework parameterization for all xDSLs, and (iii) the computed coverage measurements are useful in identifying defects of the models.
Fichier principal
Vignette du fichier
JSS__SLE_2022_Extension.pdf (5.36 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04448117 , version 1 (09-02-2024)

Identifiants

Citer

Faezeh Khorram, Erwan Bousse, Antonio Garmendia, Jean-Marie Mottu, Gerson Sunyé, et al.. A language-parametric test coverage framework for executable domain-specific languages. Journal of Systems and Software, 2024, 211, pp.111977. ⟨10.1016/j.jss.2024.111977⟩. ⟨hal-04448117⟩
67 Consultations
85 Téléchargements

Altmetric

Partager

More