Spatio-Temporal Human Shape Completion With Implicit Function Networks - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year :

Spatio-Temporal Human Shape Completion With Implicit Function Networks

Federica Bogo
  • Function : Author
  • PersonId : 1080019
Edmond Boyer


We address the problem of inferring a human shape from partial observations, such as depth images, in temporal sequences. Deep Neural Networks (DNN) have been shown successful to estimate detailed shapes on a frame-by-frame basis but consider yet little or no temporal information over frame sequences for detailed shape estimation. Recently, networks that implicitly encode shape occupancy using MLP layers have shown very promising results for such single-frame shape inference, with the advantage of reducing the dimensionality of the problem and providing continuously encoded results. In this work we propose to generalize implicit encoding to spatio-temporal shape inference with spatio-temporal implicit function networks or STIF-Nets, where temporal redundancy and continuity is expected to improve the shape and motion quality. To validate these added benefits, we collect and train with motion data from CAPE for dressed humans, and DFAUST for body shapes with no clothing. We show our model's ability to estimate shapes for a set of input frames, and interpolate between them. Our results show that our method outperforms existing state of the art methods, in particular the single-frame methods for detailed shape estimation.
Fichier principal
Vignette du fichier
STIF_hal.pdf (28.4 Mo) Télécharger le fichier
3DV2021sup.pdf (5.23 Mo) Télécharger le fichier
Origin : Files produced by the author(s)

Dates and versions

hal-03381387 , version 1 (16-10-2021)


  • HAL Id : hal-03381387 , version 1


Boyao Zhou, Jean-Sébastien Franco, Federica Bogo, Edmond Boyer. Spatio-Temporal Human Shape Completion With Implicit Function Networks. International Conference on 3D Vision, Dec 2021, Online, United Kingdom. ⟨hal-03381387⟩
157 View
126 Download


Gmail Facebook Twitter LinkedIn More