Post hoc confidence bounds on false positives using reference families - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue Annals of Statistics Année : 2020

Post hoc confidence bounds on false positives using reference families

Résumé

We follow a post-hoc, "user-agnostic" approach to false discovery control in a large-scale multiple testing framework, as introduced by Genovese and Wasserman (2006), Goeman and Solari (2011): the statistical guarantee on the number of correct rejections must hold for any set of candidate items, possibly selected by the user after having seen the data. To this end, we introduce a novel point of view based on a family of reference rejection sets and a suitable criterion, namely the joint-family-wise-error rate over that family (JER for short). First, we establish how to derive post hoc bounds froma given JER control and analyze some general properties of this approach. We then develop procedures for controlling the JER in the case where reference regions are p-value level sets. These procedures adapt to dependencies and to the unknown quantity of signal (via a step-downprinciple). We also show interesting connections to confidence envelopes of Meinshausen (2006); Genovese and Wasserman (2006), the closed testing based approach of Goeman and Solari (2011) and to the higher criticism of Donoho and Jin (2004). Our theoretical statements are supported by numerical experiments.
Fichier principal
Vignette du fichier
AOS1847.pdf (590.1 Ko) Télécharger le fichier
AOS1847_supp.pdf (432.37 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01483585 , version 1 (06-03-2017)
hal-01483585 , version 2 (09-03-2017)
hal-01483585 , version 3 (10-03-2017)
hal-01483585 , version 4 (06-01-2018)
hal-01483585 , version 5 (10-04-2019)

Identifiants

Citer

Gilles Blanchard, Pierre Neuvial, Etienne Roquain. Post hoc confidence bounds on false positives using reference families. Annals of Statistics, 2020, 48 (3), pp.1281-1303. ⟨10.1214/19-AOS1847⟩. ⟨hal-01483585v5⟩
1226 Consultations
588 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More