Towards safety monitoring of ML-based perception tasks of autonomous systems - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2020

Towards safety monitoring of ML-based perception tasks of autonomous systems

Résumé

Machine learning (ML) provides no guarantee of safe operation in safety-critical systems such as autonomous vehicles. ML decisions are based on data that tends to represent a partial and imprecise knowledge of the environment. Such probabilistic models can output wrong decisions even with 99% of confidence, potentially leading to catastrophic consequences. Moreover, modern ML algorithms such as deep neural networks (DNN) have a high level of uncertainty in their decisions, and their outcomes are not easily explainable. Therefore, a fault tolerance mechanism, such as a safety monitor (SM), should be applied to guarantee the property correctness of these systems. However, applying an SM for ML components can be complex in terms of detection and reaction. Thus, aiming at dealing with this challenging task, this work presents a benchmark architecture for testing ML components with SM, and the current work for dealing with specific ML threats. We also highlight the main issues regarding monitoring ML in safety-critical environments.
Fichier principal
Vignette du fichier
Student_paper_ISSRE_2020.pdf (142.17 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03252641 , version 1 (07-06-2021)

Identifiants

Citer

Raul Sena Ferreira. Towards safety monitoring of ML-based perception tasks of autonomous systems. 2020 IEEE International Symposium on Software Reliability Engineering Workshops (ISSREW), Oct 2020, Coimbra, Portugal. pp.135-138, ⟨10.1109/ISSREW51248.2020.00052⟩. ⟨hal-03252641⟩
47 Consultations
223 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More