Camera keyframing with style and control - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue ACM Transactions on Graphics Année : 2021

Camera keyframing with style and control

Résumé

We present a novel technique that enables 3D artists to synthesize camera motions in virtual environments following a camera style, while enforcing user-designed camera keyframes as constraints along the sequence. To solve this constrained motion in-betweening problem, we design and train a camera motion generator from a collection of temporal cinematic features (camera and actor motions) using a conditioning on target keyframes. We further condition the generator with a style code to control how to perform the interpolation between the keyframes. Style codes are generated by training a second network that encodes different camera behaviors in a compact latent space, the camera style space. Camera behaviors are defined as temporal correlations between actor features and camera motions and can be extracted from real or synthetic film clips. We further extend the system by incorporating a fine control of camera speed and direction via a hidden state mapping technique. We evaluate our method on two aspects: i) the capacity to synthesize style-aware camera trajectories with user defined keyframes; and ii) the capacity to ensure that in-between motions still comply with the reference camera style while satisfying the keyframe constraints. As a result, our system is the first style-aware keyframe in-betweening technique for camera control that balances style-driven automation with precise and interactive control of keyframes.
Fichier principal
Vignette du fichier
SIG_ASIA_2021_camera_Keyframe___Authors_version.pdf (25.25 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03519249 , version 1 (10-01-2022)

Identifiants

Citer

Hongda Jiang, Marc Christie, Xi Wang, Libin Liu, Bin Wang, et al.. Camera keyframing with style and control. ACM Transactions on Graphics, 2021, 40, pp.1 - 13. ⟨10.1145/3478513.3480533⟩. ⟨hal-03519249⟩
75 Consultations
193 Téléchargements

Altmetric

Partager

More