Transfer Learning and Bias Correction with Pre-trained Audio Embeddings - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Transfer Learning and Bias Correction with Pre-trained Audio Embeddings

Résumé

Deep neural network models have become the dominant approach to a large variety of tasks within music information retrieval (MIR). These models generally require large amounts of (annotated) training data to achieve high accuracy. Because not all applications in MIR have sufficient quantities of training data, it is becoming increasingly common to transfer models across domains. This approach allows representations derived for one task to be applied to another, and can result in high accuracy with less stringent training data requirements for the downstream task. However, the properties of pre-trained audio embeddings are not fully understood. Specifically, and unlike traditionally engineered features, the representations extracted from pre-trained deep networks may embed and propagate biases from the model's training regime. This work investigates the phenomenon of bias propagation in the context of pre-trained audio representations for the task of instrument recognition. We first demonstrate that three different pre-trained representations (VGGish, OpenL3, and YAMNet) exhibit comparable performance when constrained to a single dataset, but differ in their ability to generalize across datasets (OpenMIC and IRMAS). We then investigate dataset identity and genre distribution as potential sources of bias. Finally, we propose and evaluate post-processing countermeasures to mitigate the effects of bias, and improve generalization across datasets.
Fichier principal
Vignette du fichier
ISMIR2023 Transfer Learning and Bias Correction with Pre-trained Audio Embeddings.pdf (297.87 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : CC BY - Paternité

Dates et versions

hal-04160013 , version 1 (12-07-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04160013 , version 1

Citer

Changhong Wang, Gaël Richard, Brian Mcfee. Transfer Learning and Bias Correction with Pre-trained Audio Embeddings. The 24th conference of the International Society for Music Information Retrieval (ISMIR), Nov 2023, Milan, Italy. ⟨hal-04160013⟩
251 Consultations
70 Téléchargements

Partager

Gmail Facebook X LinkedIn More