Communication Dans Un Congrès Année : 2025

Towards Early Prediction of Self-Supervised Speech Model Performance

Résumé

In Self-Supervised Learning (SSL), pre-training and evaluation are resource intensive. In the speech domain, current indicators of the quality of SSL models during pre-training, such as the loss, do not correlate well with downstream performance. Consequently, it is often difficult to gauge the final downstream performance in a cost efficient manner during pre-training. In this work, we propose unsupervised efficient methods that give insights into the pre-training quality of SSL speech models, namely, measuring the cluster quality and rank of the embeddings produced by the SSL model. Results show that measures of cluster quality and rank correlate better with downstream performance than the pre-training loss, reducing the need for GPU hours and labeled data in SSL model evaluation.

Fichier principal
Vignette du fichier
_IS2025__Early_Prediction_SSL.pdf (260.01 Ko) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-05091409 , version 1 (31-05-2025)

Licence

Identifiants

  • HAL Id : hal-05091409 , version 1

Citer

Ryan Whetten, Lucas Maison, Titouan Parcollet, Marco Dinarelli, Yannick Estève. Towards Early Prediction of Self-Supervised Speech Model Performance. Interspeech 2025, ISCA, Aug 2025, Rotterdam, Netherlands. ⟨hal-05091409⟩
172 Consultations
196 Téléchargements

Partager

  • More