Interaction with Machine Improvisation - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Book Sections Year : 2010

Interaction with Machine Improvisation


We describe two multi-agent architectures for an improvisation oriented musician-machine interaction systems that learn in real time from human performers. The improvisation kernel is based on sequence modeling and statistical learning. We present two frameworks of interaction with this kernel. In the first, the stylistic interaction is guided by a human operator in front of an interactive computer environment. In the second framework, the stylistic interaction is delegated to machine intelligence and therefore, knowledge propagation and decision are taken care of by the computer alone. The first framework involves a hybrid architecture using two popular composition/performance environments, Max and OpenMusic, that are put to work and communicate together, each one handling the process at a different time/memory scale. The second framework shares the same representational schemes with the first but uses an Active Learning architecture based on collaborative, competitive and memory-based learning to handle stylistic interactions. Both systems are capable of processing real-time audio/video as well as MIDI. After discussing the general cognitive background of improvisation practices, the statistical modelling tools and the concurrent agent architecture are presented. Then, an Active Learning scheme is described and considered in terms of using different improvisation regimes for improvisation planning. Finally, we provide more details about the different system implementations and describe several performances with the system.
Fichier principal
Vignette du fichier
AL-chapter4.pdf (992.68 Ko) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-00694801 , version 1 (06-05-2012)



Gérard Assayag, George Bloch, Arshia Cont, Shlomo Dubnov. Interaction with Machine Improvisation. Shlomo, Argamon and Shlomo, Dubnov and Kevin, Burns. The Structure of Style: Algorithmic Approaches to Understanding Manner and Meaning, Springer, pp.219-245, 2010, 978-3-642-12337-5. ⟨10.1007/978-3-642-12337-5_10⟩. ⟨hal-00694801⟩
319 View
349 Download



Gmail Facebook X LinkedIn More