Temporal Shape Transfer Network for 3D Human Motion - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2022

Temporal Shape Transfer Network for 3D Human Motion

Abstract

This paper presents a learning-based approach to perform human shape transfer between an arbitrary 3D identity mesh and a temporal motion sequence of 3D meshes. Recent approaches tackle the human shape and pose transfer on a per-frame basis and do not yet consider the valuable information about the motion dynamics, e.g., body or clothing dynamics, inherently present in motion sequences. Recent datasets provide such sequences of 3D meshes, and this work investigates how to leverage the associated intrinsic temporal features in order to improve learning-based approaches on human shape transfer. These features are expected to help preserve temporal motion and identity consistency over motion sequences. To this aim, we introduce a new network architecture that takes as input successive 3D mesh frames in a motion sequence and which decoder is conditioned on the target shape identity. Training losses are designed to enforce temporal consistency between poses as well as shape preservation over the input frames. Experiments demonstrate substantially qualitative and quantitative improvements in using temporal features compared to optimization-based and recent learning-based methods.
Fichier principal
Vignette du fichier
temporal_shape_transfer_network.pdf (7.76 Mo) Télécharger le fichier
supplementary.pdf (4.38 Mo) Télécharger le fichier
supplementary_video.mp4 (66.78 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03782133 , version 1 (23-09-2022)

Identifiers

  • HAL Id : hal-03782133 , version 1

Cite

João Regateiro, Edmond Boyer. Temporal Shape Transfer Network for 3D Human Motion. 3DV 2022 - International Conference on 3D Vision, Sep 2022, Prague / Hybrid, Czech Republic. pp.1-9. ⟨hal-03782133⟩
159 View
292 Download

Share

Gmail Mastodon Facebook X LinkedIn More