Sound texture synthesis using Convolutional Neural Networks - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2019

Sound texture synthesis using Convolutional Neural Networks

Hugo Caracalla
  • Fonction : Auteur
  • PersonId : 1000847
Axel Roebel

Résumé

The following article introduces a new parametric synthesis algorithm for sound textures inspired by existing methods used for visual textures. Using a 2D Convolutional Neural Network (CNN), a sound signal is modified until the temporal cross-correlations of the feature maps of its log-spectrogram resemble those of a target texture. We show that the resulting synthesized sound signal is both different from the original and of high quality, while being able to reproduce singular events appearing in the original. This process is performed in the time domain, discarding the harmful phase recovery step which usually concludes synthesis performed in the time-frequency domain. It is also straightforward and flexible, as it does not require any fine tuning between several losses when synthesizing diverse sound textures. Synthesized spectrograms and sound signals are showcased, and a way of extending the synthesis in order to produce a sound of any length is also presented. We also discuss the choice of CNN, border effects in our synthesized signals and possible ways of modifying the algorithm in order to improve its current long computation time.
Fichier principal
Vignette du fichier
DAFx2019_paper_16.pdf (3.71 Mo) Télécharger le fichier
Origine : Fichiers éditeurs autorisés sur une archive ouverte
Loading...

Dates et versions

hal-02436259 , version 1 (12-01-2020)

Identifiants

  • HAL Id : hal-02436259 , version 1

Citer

Hugo Caracalla, Axel Roebel. Sound texture synthesis using Convolutional Neural Networks. Proceedings of the International Conference on Digital Audio Effects (DAFx), Sep 2019, Birmingham, United Kingdom. ⟨hal-02436259⟩
55 Consultations
99 Téléchargements

Partager

Gmail Facebook X LinkedIn More