Hearing tactile interactions, visualizing sounds, touching distances: Current directions in sensory conversion research - Archive ouverte HAL Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Hearing tactile interactions, visualizing sounds, touching distances: Current directions in sensory conversion research

Résumé

Can people ‘see’ through sounds or tactile stimuli? Can social touch be transmitted through audition? Sensory conversion technologies are designed to enrich one sensory modality by information from another sensory modality. As such, they can provide access to information from a sensory modality that has been lost (like vision for the blind) or access to novel information, thereby transforming and augmenting our perception of the world. I will first present research on sensory substitution technologies aiming at restoring visual functions by means of touch and audition. People equipped with visual-to-tactile or visual-to-auditory conversion devices are able to recognize and categorize objects, navigate in their environment, and their qualitative experience has specific multisensory characteristics. Second, I will turn to technologies aiming at transmitting social touch through auditory signals. This research appears timely as situations of social isolation has detrimental effects on well-being and mental health. In recent work conducted in my team, we recorded vibratory signals from prototypical skin-to-skin touches and applied basic sensory signal processing, creating what we refer to as “audio-touch” stimuli. We found that people listening to these sounds are able to recognize the different tactile gestures (e.g., stroking, rubbing, tapping, hitting) as well as the different emotional intentions (e.g., love, sympathy, joy, attention, fear, anger) conveyed by these social touches. Finally, based on behavioural experiences, brain activations, and qualitative experiences using these technologies, I will discuss how sensory substitution and augmentation crucially question what is a sensory modality and what becomes the relevant criteria to define the different senses.
Fichier non déposé

Dates et versions

hal-04304722 , version 1 (24-11-2023)

Identifiants

  • HAL Id : hal-04304722 , version 1

Citer

Malika Auvray. Hearing tactile interactions, visualizing sounds, touching distances: Current directions in sensory conversion research. ALIFE, Ghost in the Machine, the 2023 Conference on Artificial Life, Hiroaki MATSUMOTO, Jul 2023, Sapporo, Japan. ⟨hal-04304722⟩
33 Consultations
0 Téléchargements

Partager

Gmail Mastodon Facebook X LinkedIn More