Foley sound synthesis at the DCASE 2023 challenge - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Foley sound synthesis at the DCASE 2023 challenge

Résumé

The addition of Foley sound effects during post-production is a common technique used to enhance the perceived acoustic properties of multimedia content. Traditionally, Foley sound has been produced by human Foley artists, which involves manual recording and mixing of sound. However, recent advances in sound synthesis and generative models have generated interest in machine-assisted or automatic Foley synthesis techniques. To promote further research in this area, we have organized a challenge in DCASE 2023: Task 7-Foley Sound Synthesis. Our challenge aims to provide a standardized evaluation framework that is both rigorous and efficient, allowing for the evaluation of different Foley synthesis systems. We received 17 submissions, and performed both objective and subjective evaluation to rank them according to three criteria: audio quality, fit-to-category, and diversity. Through this challenge, we hope to encourage active participation from the research community and advance the state-of-the-art in automatic Foley synthesis. In this paper, we provide a detailed overview of the Foley sound synthesis challenge, including task definition, dataset, baseline, evaluation scheme and criteria, challenge result, and discussion.
Fichier principal
Vignette du fichier
DCASE_2023___Task_7___report__to_submit_to_workshop_.pdf (198.14 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04178960 , version 1 (08-08-2023)
hal-04178960 , version 2 (15-08-2023)

Identifiants

  • HAL Id : hal-04178960 , version 2

Citer

Keunwoo Choi, Jaekwon Im, Laurie Heller, Brian Mcfee, Keisuke Imoto, et al.. Foley sound synthesis at the DCASE 2023 challenge. 2023 Workshop on Detection and Classification of Acoustic Scenes and Events (DCASE 2023), Sep 2023, Tampere, Finland. ⟨hal-04178960v2⟩
30 Consultations
107 Téléchargements

Partager

Gmail Facebook X LinkedIn More