Correlation of Fréchet Audio Distance With Human Perception of Environmental Audio Is Embedding Dependent - Archive ouverte HAL
Communication Dans Un Congrès Année : 2024

Correlation of Fréchet Audio Distance With Human Perception of Environmental Audio Is Embedding Dependent

Junwon Lee
  • Fonction : Auteur
  • PersonId : 1154420
Keunwoo Choi
  • Fonction : Auteur
Keisuke Imoto
  • Fonction : Auteur

Résumé

This paper explores whether considering alternative domain-specific embeddings to calculate the Frechet Audio Dis- tance (FAD) metric can help the FAD to correlate better with perceptual ratings of environmental sounds. We used embeddings from VGGish, PANNs, MS-CLAP, L-CLAP, and MERT, which are tailored for either music or environmental sound evaluation. The FAD scores were calculated for sounds from the DCASE 2023 Task 7 dataset. Using perceptual data from the same task, we find that PANNs-WGM-LogMel produces the best correlation between FAD scores and perceptual ratings of both audio quality and perceived fit with a Spearman correlation higher than 0.5. We also find that music-specific embeddings resulted in significantly lower results. Interestingly, VGGish, the embedding used for the original Frechet calculation, yielded a correlation below 0.1. These results underscore the critical importance of the choice of embedding for the FAD metric design.
Fichier principal
Vignette du fichier
fretchedDcaseEmbeddings-3.pdf (261.71 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04603443 , version 1 (06-06-2024)

Identifiants

  • HAL Id : hal-04603443 , version 1

Citer

Modan Tailleur, Junwon Lee, Mathieu Lagrange, Keunwoo Choi, Laurie M Heller, et al.. Correlation of Fréchet Audio Distance With Human Perception of Environmental Audio Is Embedding Dependent. EUSIPCO, 2024, Lyon, France. ⟨hal-04603443⟩
127 Consultations
46 Téléchargements

Partager

More