Transductive conformal inference with adaptive scores - Archive ouverte HAL Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2023

Transductive conformal inference with adaptive scores

Résumé

Conformal inference is a fundamental and versatile tool that provides distribution-free guarantees for many machine learning tasks. We consider the transductive setting, where decisions are made on a test sample of $m$ new points, giving rise to $m$ conformal $p$-values. While classical results only concern their marginal distribution, we show that their joint distribution follows a P\'olya urn model, and establish a concentration inequality for their empirical distribution function. The results hold for arbitrary exchangeable scores, including adaptive ones that can use the covariates of the test+calibration samples at training stage for increased accuracy. We demonstrate the usefulness of these theoretical results through uniform, in-probability guarantees for two machine learning tasks of current interest: interval prediction for transductive transfer learning and novelty detection based on two-class classification.
Fichier principal
Vignette du fichier
GBR2023_ArXiv_Revised.pdf (1.02 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04266605 , version 1 (31-10-2023)
hal-04266605 , version 2 (19-03-2024)

Licence

Paternité

Identifiants

Citer

Ulysse Gazin, Gilles Blanchard, Etienne Roquain. Transductive conformal inference with adaptive scores. 2024. ⟨hal-04266605v2⟩
82 Consultations
28 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More