Eliciting Multimodal and Collaborative Interactions for Data Exploration on Large Vertical Displays - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue IEEE Transactions on Visualization and Computer Graphics Année : 2024

Eliciting Multimodal and Collaborative Interactions for Data Exploration on Large Vertical Displays

Gabriela Molina León
Petra Isenberg
Andreas Breiter

Résumé

We examined user preferences to combine multiple interaction modalities for collaborative interaction with data shown on large vertical displays. Large vertical displays facilitate visual data exploration and allow the use of diverse interaction modalities by multiple users at different distances from the screen. Yet, how to offer multiple interaction modalities is a non-trivial problem. We conducted an elicitation study with 20 participants that generated 1015 interaction proposals combining touch, speech, pen, and mid-air gestures. Given the opportunity to interact using these four modalities, participants preferred speech interaction in 10 of 15 low-level tasks and direct manipulation for straightforward tasks such as showing a tooltip or selecting. In contrast to previous work, participants most favored unimodal and personal interactions. We identified what we call collaborative synonyms among their interaction proposals and found that pairs of users collaborated either unimodally and simultaneously or multimodally and sequentially. We provide insights into how end-users associate visual exploration tasks with certain modalities and how they collaborate at different interaction distances using specific interaction modalities.
Fichier principal
Vignette du fichier
TVCG23_multimodal_collab_interactions_on_lvd-1.pdf (11.42 Mo) Télécharger le fichier
Vignette du fichier
Leon_2024_multimodal.png (194.58 Ko) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Format : Figure, Image

Dates et versions

hal-04365019 , version 1 (11-01-2024)

Licence

Paternité

Identifiants

Citer

Gabriela Molina León, Petra Isenberg, Andreas Breiter. Eliciting Multimodal and Collaborative Interactions for Data Exploration on Large Vertical Displays. IEEE Transactions on Visualization and Computer Graphics, 2024, 30 (2), pp.1624-1637. ⟨10.1109/TVCG.2023.3323150⟩. ⟨hal-04365019⟩
52 Consultations
6 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More