Combining wearable finger haptics and Augmented Reality: User evaluation using an external camera and the Microsoft HoloLens - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles IEEE Robotics and Automation Letters Year : 2018

Combining wearable finger haptics and Augmented Reality: User evaluation using an external camera and the Microsoft HoloLens

Abstract

Augmented Reality (AR) enriches our physical world with digital content and media, such as 3D models and videos, overlaying in real time the camera view of our smartphone, tablet, laptop, or glasses. Despite the recent massive interest for this technology, it is still not possible to receive rich haptic feedback when interacting with augmented environments. This lack is mainly due to the poor diffusion of suitable haptic interfaces, which should be easy to wear, lightweight, compact, and inexpensive. In this paper, we briefly review the state of the art on wearable haptics and its application in AR. Then, we present three AR use cases, considering tasks of manipulation, guidance, and gaming, using both external cameras with standard screens as well as fully-wearable solutions, using the Microsoft HoloLens. We evaluate these tasks enrolling a total of 34 subjects, analyzing performance and user experience when using a 3-DoF wearable device for the fingertip, a 2-DoF wearable device for the proximal finger phalanx, a vibrotactile ring, and a popular sensory substitution technique (interaction force displayed as a colored bar). Results show that providing haptic feedback through the wearable devices significantly improves the performance , intuitiveness, and comfort of the considered AR tasks.
Fichier principal
Vignette du fichier
Meli-RAL18.pdf (3.03 Mo) Télécharger le fichier
Meli-RAL18.mp4 (14.38 Mo) Télécharger le fichier
Origin Files produced by the author(s)
Loading...

Dates and versions

hal-01851705 , version 1 (30-07-2018)

Identifiers

Cite

Leonardo Meli, Claudio Pacchierotti, Gionata Salvietti, Francesco Chinello, Maurizio Maisto, et al.. Combining wearable finger haptics and Augmented Reality: User evaluation using an external camera and the Microsoft HoloLens. IEEE Robotics and Automation Letters, 2018, 3 (4), pp.4297-4304. ⟨10.1109/LRA.2018.2864354⟩. ⟨hal-01851705⟩
285 View
547 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More