Learning linguistic content embeddings for phrase and language independent utterance verification - Archive ouverte HAL
Pré-Publication, Document De Travail Année : 2024

Learning linguistic content embeddings for phrase and language independent utterance verification

Mohammad Mohammadamini
  • Fonction : Auteur
  • PersonId : 1070002
Nathan Griot
  • Fonction : Auteur
  • PersonId : 1357093
Driss Matrouf

Résumé

In this paper, we introduce a phrase and language-independent utterance verification system. The objective of an utterance verification system is to confirm whether the linguistic content of two speech utterances is the same or not. Our proposed approach is phrase and language-independent, therefore it can generalize for unseen phrases and even unseen languages. The proposed framework is based on a ResNet embedding extractor trained on the Common Voice dataset which is optimized by a linguistic content classification task.The proposed approach can be used in text-dependent speaker recognition systems, passphrase verification systems, and keyword spotting systems. Our system is tested on several protocols including Deepmine for text-dependent speaker verification and Speech Commands' keyword-spotting benchmarks. Obtaining high performance for unseen phrases and languages makes our approach plausible for utterance verification in low-resource and even zero-resource languages. For example, the EER for a protocol on Common Voice English is 0.16 while for Common Voices French without using French training data the EER is 1.23.
Fichier principal
Vignette du fichier
utterence_verification_mohammadamini.pdf (218.96 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04478250 , version 1 (26-02-2024)

Identifiants

  • HAL Id : hal-04478250 , version 1

Citer

Mohammad Mohammadamini, Nathan Griot, Driss Matrouf. Learning linguistic content embeddings for phrase and language independent utterance verification. 2024. ⟨hal-04478250⟩

Collections

UNIV-AVIGNON LIA
96 Consultations
90 Téléchargements

Partager

More