Sparse Bayesian binary logistic regression using the split-and-augmented Gibbs sampler - Archive ouverte HAL
Communication Dans Un Congrès Année : 2018

Sparse Bayesian binary logistic regression using the split-and-augmented Gibbs sampler

Résumé

Logistic regression has been extensively used to perform classification in machine learning and signal/image processing. Bayesian formulations of this model with sparsity-inducing priors are particularly relevant when one is interested in drawing credibility intervals with few active coefficients. Along these lines, the derivation of efficient simulation-based methods is still an active research area because of the analytically challenging form of the binomial likelihood. This paper tackles the sparse Bayesian binary logistic regression problem by relying on the recent split-and-augmented Gibbs sampler (SPA). Contrary to usual data augmentation strategies, this Markov chain Monte Carlo (MCMC) algorithm scales in high dimension and divides the initial sampling problem into simpler ones. These sampling steps are then addressed with efficient state-of-the-art methods, namely proximal MCMC algorithms that can benefit from the recent closed-form expression of the proximal operator of the logistic cost function. SPA appears to be faster than efficient proximal MCMC algorithms and presents a reasonable computational cost compared to optimization-based methods with the advantage of producing credibility intervals. Experiments on handwritten digits classification problems illustrate the performances of the proposed approach.

Mots clés

Fichier principal
Vignette du fichier
vono_22521.pdf (194.95 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02279425 , version 1 (05-09-2019)

Identifiants

  • HAL Id : hal-02279425 , version 1

Citer

Maxime Vono, Nicolas Dobigeon, Pierre Chainais. Sparse Bayesian binary logistic regression using the split-and-augmented Gibbs sampler. IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2018), Sep 2018, Aalborg, Denmark. pp.1-6. ⟨hal-02279425⟩
42 Consultations
306 Téléchargements

Partager

More