Coupling dense point cloud correspondence and template model fitting for 3D human pose and shape reconstruction from a single depth image - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2022

Coupling dense point cloud correspondence and template model fitting for 3D human pose and shape reconstruction from a single depth image

Abstract

In this paper, we address the problem of capturing both the shape and the pose of a character using a single depth sensor. Some previous works proposed to fit a parametric generic human template in the depth image, while others developed deep learning (DL) approaches to find the correspondence between depth pixels and vertices of the template. In this paper, we explore the possibility of combining these two approaches to benefit from their respective advantages. The hypothesis is that DL dense correspondence should provide more accurate information to template model fitting, compared to previous approaches which only use estimated joint position only. Thus, we stacked a stateof-the-art DL dense correspondence method (namely double U-Net) and parametric model fitting (namely Simplify-X). The experiments on the SURREAL [1], DFAUST datasets [2] and a subset of AMASS [3], show that this hybrid approach enables us to enhance pose and shape estimation compared to using DL or model fitting separately. This result opens new perspectives in pose and shape estimation in many applications where complex or invasive motion capture setups are impossible, such as sports, dance, ergonomic assessment, etc.
Fichier principal
Vignette du fichier
IMET_2022 non-anonymous.pdf (4.37 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03830670 , version 1 (27-10-2022)

Identifiers

Cite

Xiaofang Wang, Adnane Boukhayma, Stéphanie Prévost, Eric Desjardin, Céline Loscos, et al.. Coupling dense point cloud correspondence and template model fitting for 3D human pose and shape reconstruction from a single depth image. International Conference on Interactive Media, Smart Systems and Emerging Technologies (IMET), 2022, Limassol, Cyprus. pp.1-8, ⟨10.1109/IMET54801.2022.9929833⟩. ⟨hal-03830670⟩
118 View
136 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More