On the Impossible Safety of Large AI Models - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2023

On the Impossible Safety of Large AI Models

Résumé

Large AI Models (LAIMs), of which large language models are the most prominent recent example, showcase some impressive performance. However they have been empirically found to pose serious security issues. This paper systematizes our knowledge about the fundamental impossibility of building arbitrarily accurate and secure machine learning models. More precisely, we identify key challenging features of many of today's machine learning settings. Namely, high accuracy seems to require memorizing large training datasets, which are often user-generated and highly heterogeneous, with both sensitive information and fake users. We then survey statistical lower bounds that, we argue, constitute a compelling case against the possibility of designing high-accuracy LAIMs with strong security guarantees.
Fichier principal
Vignette du fichier
2209.15259.pdf (440.92 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04363637 , version 1 (25-12-2023)

Identifiants

  • HAL Id : hal-04363637 , version 1

Citer

El-Mahdi El-Mhamdi, Sadegh Farhadkhani, Rachid Guerraoui, Nirupam Gupta, Lê-Nguyên Hoang, et al.. On the Impossible Safety of Large AI Models. 2023. ⟨hal-04363637⟩
156 Consultations
269 Téléchargements

Partager

More