Animation Synthesis Triggered by Vocal Mimics - Archive ouverte HAL Access content directly
Conference Papers Year : 2019

Animation Synthesis Triggered by Vocal Mimics


We propose a method leveraging the naturally time-related expressivity of our voice to control an animation composed of a set of short events. The user records itself mimicking onomatopoeia sounds such as "Tick", "Pop", or "Chhh" which are associated with specific animation events. The recorded soundtrack is automatically analyzed to extract every instant and types of sounds. We finally synthesize an animation where each event type and timing correspond with the soundtrack. In addition to being a natural way to control animation timing, we demonstrate that multiple stories can be efficiently generated by recording different voice sequences. Also, the use of more than one soundtrack allows us to control different characters with overlapping actions.
Fichier principal
Vignette du fichier
main.pdf (2.19 Mo) Télécharger le fichier
MIG2019.mp4 (10.91 Mo) Télécharger le fichier

Dates and versions

hal-02307215 , version 1 (16-10-2019)



Adrien Nivaggioli, Damien Rohmer. Animation Synthesis Triggered by Vocal Mimics. Motion, Interaction and Games, Oct 2019, Newcastle, United Kingdom. ⟨10.1145/3359566.3360067⟩. ⟨hal-02307215⟩
197 View
248 Download



Gmail Mastodon Facebook X LinkedIn More