A Phonetic Analysis of Speaker Verification Systems through Phoneme selection and Integrated Gradients - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

A Phonetic Analysis of Speaker Verification Systems through Phoneme selection and Integrated Gradients

Résumé

Speaker recognition systems are usually crafted to identify or verify the identity of a given speaker independently of the linguistic content contained in the utterance used. We use two explainability techniques to analyze the impact of phonetic variations on a speaker verification system using VoxCeleb. We use Whisper and the Montreal Forced Aligner (MFA) to transcribe, then segment phonetically the Voxceleb1 test set. Phoneme selection is first used, before computation of the x-vectors, to observe which phonemes are the most discriminative through their impact on EER and MinDCF metrics. Integrated Gradients are then used to show which phonemes yielded the highest gradients comparing two speakers. We find that for the representation of the x-vector in speaker recognition systems, both consonants and vowels are relevant and important to capture the distinctive characteristics of a speaker’s voice and generate effective and discriminative representations.
Fichier principal
Vignette du fichier
Odyssey_phonetic_ASV_JSALT.pdf (3.03 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04578447 , version 1 (16-05-2024)
hal-04578447 , version 2 (24-05-2024)

Identifiants

  • HAL Id : hal-04578447 , version 2

Citer

Thomas Thebaud, Gabriel Hernandez Sierra, Sarah Flora Samson Juan, Marie Tahon. A Phonetic Analysis of Speaker Verification Systems through Phoneme selection and Integrated Gradients. Speaker and Language Recognition Workshop - Odyssey, Jun 2024, Quebec, Canada. ⟨hal-04578447v2⟩
0 Consultations
0 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More