Communication Dans Un Congrès Année : 2024

A Comparison of Differential Performance Metrics for the Evaluation of Automatic Speaker Verification Fairness

Résumé

When decisions are made and when personal data is treated by automated processes, there is an expectation of fairnessthat members of different demographic groups receive equitable treatment. This expectation applies to biometric systems such as automatic speaker verification (ASV).

We present a comparison of three candidate fairness metrics and extend previous work performed for face recognition, by examining differential performance across a range of different ASV operating points. Results show that the Gini Aggregation Rate for Biometric Equitability (GARBE) is the only one which meets three functional fairness measure criteria.

Furthermore, a comprehensive evaluation of the fairness and verification performance of five state-of-the-art ASV systems is also presented. Our findings reveal a nuanced tradeoff between fairness and verification accuracy underscoring the complex interplay between system design, demographic inclusiveness, and verification reliability.

Fichier principal
Vignette du fichier
publi-7718.pdf (3.12 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05299972 , version 1 (06-10-2025)

Licence

Identifiants

Citer

Oubaïda Chouchane, Christoph Busch, Chiara Galdi, Nicholas Evans, Massimiliano Todisco. A Comparison of Differential Performance Metrics for the Evaluation of Automatic Speaker Verification Fairness. ODYSSEY 2024, The Speaker and Language Recognition Workshop, ISCA, Jun 2024, Québec (Canada), Canada. pp.209 - 216, ⟨10.21437/odyssey.2024-30⟩. ⟨hal-05299972⟩

Collections

47 Consultations
134 Téléchargements

Altmetric

Partager

  • More