Feeling the Effort of Classical Musicians - A Pipeline from Electromyography to Smartphone Vibration for Live Music Performance - Inria - Institut national de recherche en sciences et technologies du numérique
Proceedings/Recueil Des Communications Année : 2022

Feeling the Effort of Classical Musicians - A Pipeline from Electromyography to Smartphone Vibration for Live Music Performance

Résumé

The MappEMG pipeline aims to augment the traditional classical concert experience by giving listeners access, through the sense of touch, to an intimate and non-visible dimension of the musicians’ bodily experience while performing. The live-stream pipeline produces vibrations based on muscle activity captured through surface electromyography (EMG). Therefore, MappEMG allows the audience to experience the performer’s muscle effort, an essential component of music performance which is typically unavailable to direct visual observation. The paper is divided in four sections. We first overview related works on EMG, music performance, and vibrotactile feedback. We then present conceptual and methodological issues of capturing musicians’ muscle effort related to their expressive intentions. We further explain the different components of the live-stream data pipeline: a python software named Biosiglive for data acquisition and processing, a Max/MSP patch for data post- processing and mapping, and a mobile application named hAPPtiks for real-time control of smartphones’ vibration. Finally, we discuss practical application of the pipeline in an actual music performance. Thanks to their modular structure, the tools presented could be used in different creative and biomedical contexts involving gestural control of haptic stimuli.

Dates et versions

hal-03967243 , version 1 (01-02-2023)

Identifiants

Citer

Felipe Verdugo, Amedeo Ceglia, Christian Frisson, Alexandre Burton, Mickael Begon, et al.. Feeling the Effort of Classical Musicians - A Pipeline from Electromyography to Smartphone Vibration for Live Music Performance. PubPub, 2022, ⟨10.21428/92fbeb44.3ce22588⟩. ⟨hal-03967243⟩
28 Consultations
0 Téléchargements

Altmetric

Partager

More