Somax 2 a Reactive Multi-Agent Environment for Co-Improvisation - Archive ouverte HAL Accéder directement au contenu
Poster De Conférence Année : 2022

Somax 2 a Reactive Multi-Agent Environment for Co-Improvisation

Gérard Assayag
Mikhail Malt

Résumé

Somax 2 is a multi-agent interactive system performing live machine co-improvisation with musicians, based on machine-listening, machine-learning, and generative units. The actual version ([Borg 2020], [Borg 2021a], [Borg 2021b]) is a recent development and algorithms improvement from the former Somax version and previous work in RepMus team ([Bonasse-Gahot 2012], [Bonasse-Gahot 2014], [Carsault 2017], [Carsault 2019], [Carsault 2020], [Carsault 2021]). Agents provide stylistically coherent improvisations based on learned musical knowledge while continuously listening to and adapting to input from musicians or other agents in real time. The system is trained on any musical materials chosen by the user, effectively constructing a generative model (called a corpus), from which it draws its musical knowledge and improvisation skills. Corpora, inputs and outputs can be MIDI as well as audio, and inputs can be live or streamed from Midi or audio files. Somax 2 is one of the improvisation systems descending from the well-known Omax software, presented here in a totally new implementation. As such it shares with its siblings, the general loop [listen/learn/model/generate], using some form of statistical modeling that ends up in creating a highly organized memory structure from which it can navigate into new musical organizations, while keeping style coherence, rather than generating unheard sounds as other ML systems do. However Somax 2 adds a totally new versatility by being incredibly reactive to the musician decisions, and by putting its creative agents to communicate and work together in the same way, thanks to cognitively inspired interaction strategies and finely optimized concurrent architecture that make all its units smoothly cooperate together.
Fichier principal
Vignette du fichier
SMC_Demo_poster_Somax_006.graffle.pdf (7.4 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04001271 , version 1 (22-02-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04001271 , version 1

Citer

Joakim Borg, Gérard Assayag, Mikhail Malt. Somax 2 a Reactive Multi-Agent Environment for Co-Improvisation. SMC 2022 - Sound Music & Computing, Jun 2022, Saint-Étienne, France. Proceedings of the 19th Sound and Music Computing Conference, 2022. ⟨hal-04001271⟩
100 Consultations
26 Téléchargements

Partager

Gmail Facebook X LinkedIn More