Efficient bandwidth extension of musical signals using a differentiable harmonic plus noise model - Archive ouverte HAL Accéder directement au contenu
Article Dans Une Revue EURASIP Journal on Audio, Speech, and Music Processing Année : 2023

Efficient bandwidth extension of musical signals using a differentiable harmonic plus noise model

Pierre-Amaury Grumiaux

Résumé

The task of bandwidth extension addresses the generation of missing high frequencies of audio signals based on knowledge of the low-frequency part of the sound. This task applies to various problems, such as audio coding or audio restoration. In this article, we focus on efficient bandwidth extension of monophonic and polyphonic musical signals using a differentiable digital signal processing (DDSP) model. Such a model is composed of a neural network part with relatively few parameters trained to infer the parameters of a differentiable digital signal processing model, which efficiently generates the output full-band audio signal. We first address bandwidth extension of monophonic signals, and then propose two methods to explicitely handle polyphonic signals. The benefits of the proposed models are first demonstrated on monophonic and polyphonic synthetic data against a baseline and a deep-learning-based resnet model. The models are next evaluated on recorded monophonic and polyphonic data, for a wide variety of instruments and musical genres. We show that all proposed models surpass a higher complexity deep learning model for an objective metric computed in the frequency domain. A MUSHRA listening test confirms the superiority of the proposed approach in terms of perceptual quality.
Fichier principal
Vignette du fichier
Bandwidth_extension_JASMP-2.pdf (1.86 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04320810 , version 1 (04-12-2023)

Identifiants

  • HAL Id : hal-04320810 , version 1

Citer

Pierre-Amaury Grumiaux, Mathieu Lagrange. Efficient bandwidth extension of musical signals using a differentiable harmonic plus noise model. EURASIP Journal on Audio, Speech, and Music Processing, 2023. ⟨hal-04320810⟩
12 Consultations
13 Téléchargements

Partager

Gmail Facebook X LinkedIn More