High Intrinsic Dimensionality Facilitates Adversarial Attack: Theoretical Evidence - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Information Forensics and Security Année : 2020

High Intrinsic Dimensionality Facilitates Adversarial Attack: Theoretical Evidence

Résumé

Machine learning systems are vulnerable to adversarial attack. By applying to the input object a small, carefully-designed perturbation, a classifier can be tricked into making an incorrect prediction. This phenomenon has drawn wide interest, with many attempts made to explain it. However, a complete understanding is yet to emerge. In this paper we adopt a slightly different perspective, still relevant to classification. We consider retrieval, where the output is a set of objects most similar to a user-supplied query object, corresponding to the set of k-nearest neighbors. We investigate the effect of adversarial perturbation on the ranking of objects with respect to a query. Through theoretical analysis, supported by experiments, we demonstrate that as the intrinsic dimensionality of the data domain rises, the amount of perturbation required to subvert neighborhood rankings diminishes, and the vulnerability to adversarial attack rises. We examine two modes of perturbation of the query: either 'closer' to the target point, or 'farther' from it. We also consider two perspectives: 'query-centric', examining the effect of perturbation on the query's own neighborhood ranking, and 'target-centric', considering the ranking of the query point in the target's neighborhood set. All four cases correspond to practical scenarios involving classification and retrieval.
Fichier principal
Vignette du fichier
LID.pdf (2.73 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02938099 , version 1 (08-12-2020)
hal-02938099 , version 2 (08-12-2020)

Identifiants

Citer

Laurent Amsaleg, James Bailey, Amelie Barbe, Sarah Erfani, Teddy Furon, et al.. High Intrinsic Dimensionality Facilitates Adversarial Attack: Theoretical Evidence. IEEE Transactions on Information Forensics and Security, 2020, 16, pp.1-12. ⟨10.1109/TIFS.2020.3023274⟩. ⟨hal-02938099v2⟩
330 Consultations
215 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More