Controllable Variation Synthesis for Surface Motion Capture - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2018

Controllable Variation Synthesis for Surface Motion Capture

Adnane Boukhayma
  • Function : Author
  • PersonId : 986748
Edmond Boyer

Abstract

We address the problem of generating variations of captured 4D models automatically, and we particularly focus on dynamic human shapes as observed from multi-view videos. Variation is an essential component of motion realism, however recent mesh animation datasets and tools lack such richness. Given a few 4D models representing movements of the same type, our method builds a probabilistic low dimensional embedding of shape poses using Gaussian Process Dynamical Models, and novel variants of motions are obtained by sampling trajectories from this manifold using Monte Carlo Markov Chain. We can synthesize an unlimited number of variations of any of the input movements, and also any blended version of them, without costly non-linear interpolation of input movement variations in mesh domain. The output variations are statistically similar to the input movements but yet slightly different in poses and timings. As we show through our results, the generated mesh sequences match the training examples in realism, which facilitates 4D model dataset augmentation.
Fichier principal
Vignette du fichier
SurfMoVar.pdf (7.28 Mo) Télécharger le fichier
Vignette du fichier
pipe.png (284.63 Ko) Télécharger le fichier
3.mp4 (23.18 Mo) Télécharger le fichier
Vignette du fichier
pipe.jpg (56.14 Ko) Télécharger le fichier
poster.pdf (6.06 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Format : Figure, Image
Origin : Files produced by the author(s)
Format : Video
Origin : Files produced by the author(s)
Format : Figure, Image
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-01590648 , version 1 (19-09-2017)

Identifiers

Cite

Adnane Boukhayma, Edmond Boyer. Controllable Variation Synthesis for Surface Motion Capture. 3DV 2017 - International Conference on 3D Vision, Oct 2017, Qingdao, China. pp.309-317, ⟨10.1109/3DV.2017.00043⟩. ⟨hal-01590648⟩
335 View
368 Download

Altmetric

Share

Gmail Facebook X LinkedIn More