A Topo-Phonic Table for Tangible Sonic Interaction
Résumé
We describe an interactive sound installation project consisting of a specially designed table with a patterned surface that allows rich and expressive tangible sonic interaction by rubbing, scraping and hitting it with the hands or objects. We will concentrate on the aspects of gesture tracking and analysis in order to detect the location and type of interaction on the surface, although only a single piezo signal is the sole source of information. For this we have recorded a database of varied types of interactions and report satisfactory classification accuracy using Gaussian mixture models on an MFCC representation of the input. Sound synthesis is performed by convolution of the piezo signal with a set of impulse responses mixed according to the GMM output, with the additional feature of triggering of sounds by attack detection.
Origine | Fichiers produits par l'(les) auteur(s) |
---|
Loading...