An Integrated Framework for Understanding Multimodal Embodied Experiences in Interactive Virtual Reality - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2023

An Integrated Framework for Understanding Multimodal Embodied Experiences in Interactive Virtual Reality

Abstract

Virtual Reality (VR) technology enables ``embodied interactions'' in realistic environments where users can freely move and interact, with deep physical and emotional states. However, a comprehensive understanding of the embodied user experience is currently limited by the extent to which one can make relevant observations, and the accuracy at which observations can be interpreted. Paul Dourish proposed a way forward through the characterisation of embodied interactions in three senses: ontology, intersubjectivity, and intentionality. In a joint effort between computer and neuro-scientists, we built a framework to design studies that investigate multimodal embodied experiences in VR, and apply it to study the impact of simulated low-vision on user navigation. Our methodology involves the design of 3D scenarios annotated with an ontology, modelling intersubjective tasks, and correlating multimodal metrics such as gaze and physiology to derive intentions. We show how this framework enables a more fine-grained understanding of embodied interactions in behavioural research.
Fichier principal
Vignette du fichier
IMX.pdf (5.11 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Licence
Copyright

Dates and versions

hal-04102737 , version 1 (22-05-2023)
hal-04102737 , version 2 (16-06-2023)

Licence

Copyright

Identifiers

Cite

Florent Alain Sauveur Robert, Hui-Yin Wu, Lucile Sassatelli, Stephen Ramanoel, Auriane Gros, et al.. An Integrated Framework for Understanding Multimodal Embodied Experiences in Interactive Virtual Reality. 2023 IMX - ACM International Conference on Interactive Media Experiences, Jun 2023, Nantes, France. https://dl.acm.org/conference/imx, ⟨10.1145/3573381.3596150⟩. ⟨hal-04102737v2⟩
298 View
83 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More