Testing a non-deterministic robot in simulation - How many repeated runs ? - Archive ouverte HAL
Communication Dans Un Congrès Année : 2020

Testing a non-deterministic robot in simulation - How many repeated runs ?

Résumé

Testing autonomous robots requires test campaigns in the field that could be expensive, risky for the system and its environment, or even impossible to set up. To cope with these limits, an expanding approach is to perform tests in virtual environments using simulators. Due to the non-determinism of the robot control and simulation execution, a test might fail or pass with exactly the same inputs (same world and mission). An important question is thus: how many runs are required to activate a fault? We particularly focus in this paper on the efficiency of repeated runs and world diversity in the context of functional testing. We address this research question with an industrial case study-an agricultural weeding robot developed by Naïo Technologies. We conclude that, in this case study, test input diversity is more efficient than repeated runs in order to activate faults. More importantly, we propose an experimental approach to assess the impact of the non-determinism, which may be reused in other case studies.
Fichier principal
Vignette du fichier
IRC_2020.pdf (3.22 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02444350 , version 1 (17-01-2020)

Identifiants

Citer

Clément Robert, Jérémie Guiochet, Hélène Waeselynck. Testing a non-deterministic robot in simulation - How many repeated runs ?. The fourth IEEE International Conference on Robotic Computing (IRC 2020), Mar 2020, Taichung, Taiwan. 8p., ⟨10.1109/IRC.2020.00048⟩. ⟨hal-02444350⟩
186 Consultations
417 Téléchargements

Altmetric

Partager

More