Interactive Body-Driven Graphics for Augmented Video Performance - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2019

Interactive Body-Driven Graphics for Augmented Video Performance

Li-Yi Wei
  • Function : Author
  • PersonId : 1042400
Wilmot Li
  • Function : Author


We present a system that augments live presentation videos with interactive graphics to create a powerful and expressive storytelling environment. Using our system, the presenter interacts with the graphical elements in real-time with gestures and postures, thus leveraging our innate, everyday skills to enhance our communication capabilities with the audience. However, crafting such an interactive and expressive performance typically requires programming, or highly-specialized tools tailored for experts. Our core contribution is a flexible, direct manipulation UI which enables amateurs and experts to craft such presentations beforehand by mapping a variety of body movements to a wide range of graphical manipulations. By simplifying the mapping between gestures, postures, and their corresponding output effects, our UI enables users to craft customized, rich interactions with the graphical elements. Our user study demonstrates the potential usage and unique affordance of this mixed-reality medium for storytelling and presentation across a range of application domains.
Fichier principal
Vignette du fichier
final.pdf (10.29 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-02005318 , version 1 (04-02-2019)



Nazmus Saquib, Rubaiat Habib Kazi, Li-Yi Wei, Wilmot Li. Interactive Body-Driven Graphics for Augmented Video Performance. CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019, May 2019, Glasgow, United Kingdom. ⟨10.1145/3290605⟩. ⟨hal-02005318⟩
613 View
3149 Download



Gmail Facebook X LinkedIn More