Understanding Collaborative Learning of Molecular Structures in AR With Eye Tracking - Inria - Institut national de recherche en sciences et technologies du numérique
Journal Articles IEEE Computer Graphics and Applications Year : 2024

Understanding Collaborative Learning of Molecular Structures in AR With Eye Tracking

Tobias Rau
Maurice Koch
Nelusa Pathmanathan
Tobias Isenberg
Daniel Weiskopf
Michael Sedlmair
Andreas Köhn
Kuno Kurzhals

Abstract

We present an approach for onsite instruction of multiple students accompanied by gaze-based monitoring to observe patterns of visual attention during task solving. We focus on collaborative processes in augmented reality (AR) that play an essential role in onsite and remote teaching alike. From a teaching perspective, it is important in such scenarios to communicate content and tasks effectively, observe whether students understand the task, and help appropriately. In our setting, students work with head-mounted displays with eye-tracking support to collaborate in a co-located space. The supervisor can observe the scene and the students and interact with them in a hybrid setup using both AR and a desktop PC. Attention monitoring and guidance are facilitated via a bidirectional mapping between 2-D structural formulas and 3-D molecules. We showcase our approach with an interactive teaching scenario in which chemistry students learn aspects of stereochemistry by interacting with virtual 3-D models of molecular structures. An interview with supervisors and students showed that our approach has much potential in classroom applications for engaging students in collaborative task solving, and assisting teachers in monitoring and supporting the learning processes of their students.
Fichier principal
Vignette du fichier
Rau_2024_UCL.pdf (17.92 Mo) Télécharger le fichier
Vignette du fichier
Rau_2024_UCL.jpg (11.91 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Format Figure, Image

Dates and versions

hal-04873245 , version 1 (08-01-2025)

Licence

Copyright

Identifiers

Cite

Tobias Rau, Maurice Koch, Nelusa Pathmanathan, Tobias Isenberg, Daniel Weiskopf, et al.. Understanding Collaborative Learning of Molecular Structures in AR With Eye Tracking. IEEE Computer Graphics and Applications, 2024, 44 (6), pp.39-51. ⟨10.1109/MCG.2024.3503903⟩. ⟨hal-04873245⟩
0 View
0 Download

Altmetric

Share

More