3D interaction techniques for musical expression - Archive ouverte HAL Access content directly
Journal Articles Journal of New Music Research Year : 2020

3D interaction techniques for musical expression


As Virtual Reality headsets become accessible, more and more artistic applications are developed, including immersive musical instruments. 3D interaction techniques designed in the 3D User Interfaces research community, such as navigation, selection and manipulation techniques, open numerous opportunities for musical control. For example, navigation techniques such as teleportation, free walking/flying and path-planning enable different ways of accessing musical scores, scenes of spatialized sounds sources or even parameter spaces. Manipulation techniques provide novel gestures and metaphors, e.g. for drawing or sculpting sound entities. Finally, 3D selection techniques facilitate the interaction with complex visual structures which can represent hierarchical temporal structures, audio graphs, scores or parameter spaces. However, existing devices and techniques were developed mainly with a focus on efficiency, i.e. minimising error rate and task completion times. They were therefore not designed with the specifics of musical interaction in mind. In this paper , we review existing 3D interaction techniques and examine how they can be used for musical control, including the possibilities they open for instrument designers. We then propose a number of research directions to adapt and extend 3DUIs for musical expression
Fichier principal
Vignette du fichier
interactapasample_auth.pdf (7.04 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02430634 , version 1 (07-01-2020)



Florent Berthaut. 3D interaction techniques for musical expression. Journal of New Music Research, inPress, ⟨10.1080/09298215.2019.1706584⟩. ⟨hal-02430634⟩
189 View
138 Download



Gmail Facebook Twitter LinkedIn More