Variational Bayes logistic regression as regularized fusion for NIST SRE 2010 - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2012

Variational Bayes logistic regression as regularized fusion for NIST SRE 2010

Résumé

Fusion of the base classifiers is seen as the way to achieve high performance in state-of-the-art speaker verification systems. Typically, we are looking for base classifiers that would be complementary. We might also be interested in reinforcing good base classifiers by including others that are similar to it. In any case, the final ensemble size is typically small and has to be formed based on some rules of thumb. We are interested to find out the subset of classifiers that has a good generalization performance. We approach the problem from the sparse learning point of view. We assume that the true, but unknown, fusion weights are actually sparse. As a practical solution we regular-ize the weighted logistic regression loss function by the Elastic-Net constraint. Though sparse solutions can be easily obtained using the so-called least absolute shrinkage and selection operator (LASSO), but it does not take into account high correlation between classifiers. Elastic-Net, on the other hand, is a compromise between LASSO and ridge regression constraints. While ridge regression cannot produce sparse solutions, Elastic-Net can. By using sparseness enforcing constraint we are able to improve over the un-regularized solution in all but tel-tel condition .
Fichier principal
Vignette du fichier
regularized-fusion-Odyssey.pdf (417.17 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-01927593 , version 1 (20-11-2018)

Identifiants

  • HAL Id : hal-01927593 , version 1

Citer

Ville Hautamäki, Kong Aik Lee, Anthony Larcher, Tomi Kinnunen, Haizhou Li. Variational Bayes logistic regression as regularized fusion for NIST SRE 2010. Speaker Odyssey, Jun 2012, Singapour, Singapore. ⟨hal-01927593⟩
74 Consultations
44 Téléchargements

Partager

Gmail Facebook X LinkedIn More