VideoDoodles: Hand-Drawn Animations on Videos with Scene-Aware Canvases - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles ACM Transactions on Graphics Year : 2023

VideoDoodles: Hand-Drawn Animations on Videos with Scene-Aware Canvases

Cuong Nguyen
  • Function : Author
  • PersonId : 1253054
Oliver Wang
  • Function : Author
  • PersonId : 1253055

Abstract

We present an interactive system to ease the creation of so-called "video doodles" -- videos on which artists insert hand-drawn animations for entertainment or educational purposes. Video doodles are challenging to create because to be convincing, the inserted drawings must appear as if they were part of the captured scene. In particular, the drawings should undergo tracking, perspective deformations and occlusions as they move with respect to the camera and to other objects in the scene -- visual effects that are difficult to reproduce with existing 2D video editing software. Our system supports these effects by relying on planar canvases that users position in a 3D scene reconstructed from the video. Furthermore, we present a custom tracking algorithm that allows users to anchor canvases to static or dynamic objects in the scene, such that the canvases move and rotate to follow the position and direction of these objects. When testing our system, novices could create a variety of short animated clips in a dozen of minutes, while professionals praised its speed and ease of use compared to existing tools.
Fichier principal
Vignette du fichier
VideoDoodles.pdf (45.94 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04093195 , version 1 (09-05-2023)

Identifiers

Cite

Emilie Yu, Kevin Blackburn-Matzen, Cuong Nguyen, Oliver Wang, Rubaiat Habib Kazi, et al.. VideoDoodles: Hand-Drawn Animations on Videos with Scene-Aware Canvases. ACM Transactions on Graphics, 2023, 42 (4), ⟨10.1145/3592413⟩. ⟨hal-04093195⟩
106 View
5 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More