Configurable EBEN: Extreme Bandwidth Extension Network to enhance body-conducted speech capture - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue IEEE/ACM Transactions on Audio, Speech and Language Processing Année : 2023

Configurable EBEN: Extreme Bandwidth Extension Network to enhance body-conducted speech capture

Résumé

This paper presents a configurable version of Extreme Bandwidth Extension Network (EBEN), a Generative Adversarial Network (GAN) designed to improve audio captured with body-conduction microphones. We show that although these microphones significantly reduce environmental noise, this insensitivity to ambient noise happens at the expense of the bandwidth of the speech signal acquired by the wearer of the devices. The obtained captured signals therefore require the use of signal enhancement techniques to recover the full-bandwidth speech. EBEN leverages a configurable multiband decomposition of the raw captured signal. This decomposition allows the data time domain dimensions to be reduced and the full band signal to be better controlled. The multiband representation of the captured signal is processed through a U-Net-like model, which combines feature and adversarial losses to generate an enhanced speech signal. We also benefit from this original representation in the proposed configurable discriminators architecture. The configurable EBEN approach can achieve state-of-the-art enhancement results on synthetic data with a lightweight generator that allows real-time processing.
Fichier principal
Vignette du fichier
eben.pdf (4.9 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04037315 , version 1 (20-03-2023)
hal-04037315 , version 2 (12-09-2023)

Licence

Paternité

Identifiants

Citer

Julien Hauret, Thomas Joubaud, Éric Bavu, Véronique Zimpfer. Configurable EBEN: Extreme Bandwidth Extension Network to enhance body-conducted speech capture. IEEE/ACM Transactions on Audio, Speech and Language Processing, 2023, 31, pp.3499-3512. ⟨10.1109/TASLP.2023.3313433⟩. ⟨hal-04037315v2⟩
114 Consultations
52 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More