Groove2Groove: One-Shot Music Style Transfer with Supervision from Synthetic Data - Département Image, Données, Signal Accéder directement au contenu
Article Dans Une Revue IEEE/ACM Transactions on Audio, Speech and Language Processing Année : 2020

Groove2Groove: One-Shot Music Style Transfer with Supervision from Synthetic Data

Résumé

Style transfer is the process of changing the style of an image, video, audio clip or musical piece so as to match the style of a given example. Even though the task has interesting practical applications within the music industry, it has so far received little attention from the audio and music processing community. In this paper, we present Groove2Groove, a one-shot style transfer method for symbolic music, focusing on the case of accompaniment styles in popular music and jazz. We propose an encoder-decoder neural network for the task, along with a synthetic data generation scheme to supply it with parallel training examples. This synthetic parallel data allows us to tackle the style transfer problem using end-to-end supervised learning, employing powerful techniques used in natural language processing. We experimentally demonstrate the performance of the model on style transfer using existing and newly proposed metrics, and also explore the possibility of style interpolation.
Fichier principal
Vignette du fichier
Groove2Groove.pdf (3.26 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Loading...

Dates et versions

hal-02923548 , version 1 (27-08-2020)
hal-02923548 , version 2 (17-09-2020)

Identifiants

Citer

Ondřej Cífka, Umut Şimşekli, Gael Richard. Groove2Groove: One-Shot Music Style Transfer with Supervision from Synthetic Data. IEEE/ACM Transactions on Audio, Speech and Language Processing, 2020, 28, pp.2638-2650. ⟨10.1109/TASLP.2020.3019642⟩. ⟨hal-02923548v2⟩
635 Consultations
1398 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More