Perceptually Motivated Spatial Audio Scene Description and Rendering for 6-DoF Immersive Music Experiences - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Perceptually Motivated Spatial Audio Scene Description and Rendering for 6-DoF Immersive Music Experiences

Jean-Marc Jot
  • Fonction : Auteur
Thibaut Carpentier
  • Fonction : Auteur
  • PersonId : 1361
  • IdHAL : tcarpent

Résumé

In recorded, live, virtual-or augmented-reality immersive musical experiences, the audio presentation may not be prescribed by the geometrical and physical model of a room or acoustic enclosure (as may often be expected, for instance, in architectural acoustic design and in video games or virtual reality). In previous work, a generic spatial audio rendering engine and interface were proposed, compatible with both physically-and perceptually-based representations of interactive audio scenes navigable at playback time. This parametric model builds and extends upon concepts proposed previously in spatial audio programming or media standard specifications, including OpenAL and MPEG-4. It enables prioritizing auditory plausibility over simulation exactness, facilitating low-complexity implementation even for large multi-object audio scenes, by sharing a "multiroom" acoustic reverberation and reflections processor. In this paper, we review seminal research on subjective room acoustics and the design of the perceptually based spatialization interface realized in IRCAM Spat. The resulting "Spatial Audio Object Workstation" is consistent with familiar content creation tools and workflows, and enhances their functionality with fine control of the spatial motion (including distance and orientation), directionality, presence, and reverberance of each sound source. Finally, we propose a generic immersive audio coding format as a container of "6-DoF spatial audio objects" to advance a future interoperable audio content and experience ecosystem.
Fichier principal
Vignette du fichier
jot_i3da_2023.pdf (3.74 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04270811 , version 1 (05-11-2023)

Identifiants

Citer

Jean-Marc Jot, Thibaut Carpentier, Olivier Warusfel. Perceptually Motivated Spatial Audio Scene Description and Rendering for 6-DoF Immersive Music Experiences. 2023 Immersive and 3D Audio: from Architecture to Automotive (I3DA), Sep 2023, Bologna, Italy. ⟨10.1109/I3DA57090.2023.10289196⟩. ⟨hal-04270811⟩
84 Consultations
97 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More