Communication Dans Un Congrès Année : 2024

Exploring visual-auditory coherence in virtual environments: a perceptual study

Résumé

The study presented here explores the perceived visual-auditory (VA) coherence between acoustic environments and their visual representations, addressing two main questions: are we able to associate room acoustics with their own visual representations, and does the type of visual rendering affect this judgment? A virtual reality (VR) experiment was conducted with five acoustic environments auralized through a Higher Order Ambisonics (HOA) multichannel system, each presented along with three types of visual representations: 360 photos, textured point clouds, and simple 3D models, rendered through a VR headset. For each VA condition, participants were asked to answer a simple question: "Do you think the sound you are hearing was produced in the environment you are seeing? Y/N." Results indicated that congruent situations were not consistently perceived as coherent, and the type of visual rendering did not influence judgments. These findings have implications for applications in cinema, video games, architectural simulation, and virtual reality.

Fichier principal
Vignette du fichier
2024_AVAR_Fargeot.pdf (4.51 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04949257 , version 1 (14-02-2025)

Licence

Identifiants

  • HAL Id : hal-04949257 , version 1

Citer

Simon Fargeot, Mitsuko Aramaki, Richard Kronland-Martinet. Exploring visual-auditory coherence in virtual environments: a perceptual study. AES 5th International Conference on Audio for Virtual and Augmented Reality, DigiPen Institute of Technology, Aug 2024, Redmond, WA, United States. ⟨hal-04949257⟩
93 Consultations
199 Téléchargements

Partager

  • More