HandyNotes: using the hands to create semantic representations of contextually aware real-world objects - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2024

HandyNotes: using the hands to create semantic representations of contextually aware real-world objects

Résumé

This paper uses Mixed Reality (MR) technologies to provide a seamless integration of digital information in physical environments through human-made annotations. Creating digital annotations of physical objects evokes many challenges for performing (simple) tasks such as adding digital notes and connecting them to real-world objects. For that, we have developed an MR system using the Microsoft HoloLens2 to create semantic representations of contextually-aware real-world objects while interacting with holographic virtual objects. User interaction is enhanced with use of fingers as placeholders for menu items. We demonstrate our approach through two real-world scenarios. We also discuss the challenges for using MR technologies.
Fichier principal
Vignette du fichier
2024015132.pdf (3.34 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Licence : Copyright (Tous droits réservés)

Dates et versions

hal-04425616 , version 1 (30-01-2024)

Licence

Copyright (Tous droits réservés)

Identifiants

  • HAL Id : hal-04425616 , version 1

Citer

Clément Quere, Aline Menin, Raphaël Julien, Hui-Yin Wu, Marco Winckler. HandyNotes: using the hands to create semantic representations of contextually aware real-world objects. IEEE VR 2024 - The 31st IEEE Conference on Virtual Reality and 3D User Interfaces, Mar 2024, Orlando, Florida, United States. ⟨hal-04425616⟩
121 Consultations
23 Téléchargements

Partager

Gmail Facebook X LinkedIn More