Perceptual characterization of motion evoked by sounds for synthesis control purposes - Archive ouverte HAL
Journal Articles ACM Transactions on Applied Perception Year : 2013

Perceptual characterization of motion evoked by sounds for synthesis control purposes

Adrien Merer
  • Function : Author
  • PersonId : 853800
Mitsuko Aramaki
Sølvi Ystad
Richard Kronland-Martinet

Abstract

This paper addresses the question of synthesis and control of sound attributes from a perceptual point of view. We focussed on an attribute related to the general concept of motion evoked by sounds. To investigate this concept, we tested 40 monophonic abstract sounds on listeners via a questionnaire and drawings, using a parametrized custom interface. This original procedure, which was defined with synthesis and control perspectives in mind, provides an alternative means of determining intuitive control parameters for synthesizing sounds evoking motion. Results showed that 3 main shape categories (linear, with regular oscillations and with circular oscillations) and 3 types of direction (rising, descending and horizontal) were distinguished by the listeners. In addition, the subjects were able to perceive the low-frequency oscillations (below 8 Hz) quite accurately. Three size categories (small, medium, large) and 3 levels of randomness (none, low amplitude irregularities, high amplitude irregularities) and speed (constant speed and speeds showing medium and large variations) were also observed in our analyses of the participants' drawings. We further performed a perceptual test to confirm the relevance of the contribution of some variables with synthesized sounds combined with visual trajectories. Based on these results, a general typology of evoked motion was drawn up and an intuitive control strategy was designed, based on a symbolic representation of continuous trajectories (provided by devices such as motion capture systems, pen tablets, etc.). These generic tools could be used in a wide range of applications such as sound design, virtual reality, sonification and music.

Domains

Sound [cs.SD]
No file

Dates and versions

hal-00741968 , version 1 (15-10-2012)

Identifiers

Cite

Adrien Merer, Mitsuko Aramaki, Sølvi Ystad, Richard Kronland-Martinet. Perceptual characterization of motion evoked by sounds for synthesis control purposes. ACM Transactions on Applied Perception, 2013, 10 (1), pp.1-24. ⟨10.1145/2422105.2422106⟩. ⟨hal-00741968⟩
171 View
0 Download

Altmetric

Share

More