Using Web Audio Modules for Immersive Audio Collaboration in the Musical Metaverse - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2024

Using Web Audio Modules for Immersive Audio Collaboration in the Musical Metaverse

Résumé

W3C Web standards now enable online applications that were unthinkable just a few years ago. In 2020, the Web Audio Modules V2 (WAM) initiative, known as "VST for the web", revolutionized music on the web. WAMs facilitate host applications using reusable web components such as note generators, virtual instruments and audio effects. Today, the WAM ecosystem includes over 100 plugins, tutorials and host applications such as Sequencer Party, a real-time collaborative platform built entirely with WAMs, that allows multiple participants to build music installations by patching plugins together. This article adapts the concepts of Sequencer Party to the musical metaverse, reusing existing WAMs without modification and generating new 3D interfaces for VR/XR use. BabylonJS was used for 3D rendering with WebXR support, and a "Conflict-Free Replicated Data Type » (CRDT) approach was chosen for client synchronization. The software is opensource and hosted online.

Fichier principal
Vignette du fichier
2024263260.pdf (1.04 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04695228 , version 1 (12-09-2024)

Licence

Identifiants

  • HAL Id : hal-04695228 , version 1

Citer

Michel Buffa, Ayoub Hofr, Dorian Girard. Using Web Audio Modules for Immersive Audio Collaboration in the Musical Metaverse. IS2 2024 - IEEE International Symposium on the Internet of Sounds 2024, Sep 2024, Erlangen, Germany. ⟨hal-04695228⟩
0 Consultations
0 Téléchargements

Partager

More