Abstract layer for leakyReLU for neural network verification based on abstract interpretation - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Access Année : 2023

Abstract layer for leakyReLU for neural network verification based on abstract interpretation

Résumé

Deep neural networks have been widely used in several complex tasks such as robotics, self-driving cars, medicine, etc. However, they have recently shown to be vulnerable in uncertain environments where inputs are noisy. As a consequence, the robustness of neural networks has become an essential property for their application in critical systems. Robustness is the capacity to take the same decision even when inputs are disturbed under different types of perturbations, including adversarial attacks. The great difficulty today is providing a formal guarantee of robustness, which is the context of this paper. To do so, abstract interpretation, a popular state-of-the-art method, consisting of converting the layers of the neural network into abstract layers, has been recently proposed. An abstract layer can act on a geometric abstract object or shape comprising implicitly an infinite number of inputs rather than an individual input. In this paper, we propose a new mathematical formulation of an abstract transformer to convert a LeakyReLU activation layer to an abstract layer. Moreover, we implement and integrate our transformer into the ERAN tool. For validation, we assess the performance of our transformer according to the LeakyReLU hyperparameter, and we study the robustness of the neural network according to the input perturbation intensity. Our approach is evaluated on three different datasets: MNIST, Fashion and a robotic dataset. The obtained results demonstrate the efficacy of our abstract transformer in terms of mathematical formulation and implementation.
Fichier principal
Vignette du fichier
Mellouki et al. (2023) - Abstract Layer for LeakyReLU for Neural Network Verification based on Abstract Inte.pdf (3.43 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-04058040 , version 1 (04-04-2023)

Identifiants

Citer

Omar El Mellouki, Mohamed Ibn Khedher, Mounim A El-Yacoubi. Abstract layer for leakyReLU for neural network verification based on abstract interpretation. IEEE Access, 2023, 11, pp.33401 - 33413. ⟨10.1109/ACCESS.2023.3263145⟩. ⟨hal-04058040⟩
88 Consultations
42 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More