VideoDoodles: Hand-Drawn Animations on Videos with Scene-Aware Canvases - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Article Dans Une Revue ACM Transactions on Graphics Année : 2023

VideoDoodles: Hand-Drawn Animations on Videos with Scene-Aware Canvases

Cuong Nguyen
  • Fonction : Auteur
  • PersonId : 1253054
Oliver Wang
  • Fonction : Auteur
  • PersonId : 1253055

Résumé

We present an interactive system to ease the creation of so-called "video doodles" -- videos on which artists insert hand-drawn animations for entertainment or educational purposes. Video doodles are challenging to create because to be convincing, the inserted drawings must appear as if they were part of the captured scene. In particular, the drawings should undergo tracking, perspective deformations and occlusions as they move with respect to the camera and to other objects in the scene -- visual effects that are difficult to reproduce with existing 2D video editing software. Our system supports these effects by relying on planar canvases that users position in a 3D scene reconstructed from the video. Furthermore, we present a custom tracking algorithm that allows users to anchor canvases to static or dynamic objects in the scene, such that the canvases move and rotate to follow the position and direction of these objects. When testing our system, novices could create a variety of short animated clips in a dozen of minutes, while professionals praised its speed and ease of use compared to existing tools.
Fichier principal
Vignette du fichier
VideoDoodles.pdf (45.94 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04093195 , version 1 (09-05-2023)

Identifiants

Citer

Emilie Yu, Kevin Blackburn-Matzen, Cuong Nguyen, Oliver Wang, Rubaiat Habib Kazi, et al.. VideoDoodles: Hand-Drawn Animations on Videos with Scene-Aware Canvases. ACM Transactions on Graphics, 2023, 42 (4), ⟨10.1145/3592413⟩. ⟨hal-04093195⟩
103 Consultations
3 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More