Designing Movement Driven Audio Applications Using a Web-Based Interactive Machine Learning Toolkit - Archive ouverte HAL Access content directly
Conference Papers Year :

Designing Movement Driven Audio Applications Using a Web-Based Interactive Machine Learning Toolkit

(1, 2) , (2) , (2)
1
2

Abstract

This paper presents a web based toolkit for implementing Interactive Machine Learning (IML) dedicated to creative audio applications. The toolkit, composed of a main library and a template application , facilitates the creation of experiences on collective musical interactions with a strong emphasis on real-time movement processing and recognition. At its lower level, the mano-js library proposes a user-friendly API built on top of existing libraries. The library is designed to assist developers and creative coders in the appropriation and usage of the Interactive Machine Learning concepts and workflow, as well as to simplify development of new applications. The library is open-source, based on web standards and released under the BSD-3-Clause Licence. At its higher level, the toolkit proposes Elements, a template application designed towards non-developer users. The application specifically aims at providing a mean for researchers and designers to prototype new movement-based distributed Interactive Machine Learning scenarios. The application allows to create a new scenario by simply providing a JSON configuration file that defines the role and the abilities of each client. The application has been iteratively tested and developed in the context of several workshops.
Fichier principal
Vignette du fichier
2018-WAC - Designing Movement Driven Audio Applications Using a Web-Based Interactive Machine Learning Toolkit.pdf (564.6 Ko) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01874966 , version 1 (30-07-2019)

Identifiers

  • HAL Id : hal-01874966 , version 1

Cite

Benjamin Matuszewski, Joseph Larralde, Frédéric Bevilacqua. Designing Movement Driven Audio Applications Using a Web-Based Interactive Machine Learning Toolkit. Web Audio Conference (WAC), Sep 2018, Berlin, Germany. ⟨hal-01874966⟩
126 View
82 Download

Share

Gmail Facebook Twitter LinkedIn More