Human Body Shape Completion with Implicit Shape and Flow Learning - Inria - Institut national de recherche en sciences et technologies du numérique
Communication Dans Un Congrès Année : 2023

Human Body Shape Completion with Implicit Shape and Flow Learning

Boyao Zhou
  • Fonction : Auteur
  • PersonId : 1080018
Di Meng
  • Fonction : Auteur
  • PersonId : 1165410
Edmond Boyer

Résumé

In this paper, we investigate how to complete human body shape models by combining shape and flow estimation given two consecutive depth images. Shape completion is a challenging task in computer vision that is highly under-constrained when considering partial depth observations. Besides model based strategies that exploit strong priors, and consequently struggle to preserve fine geometric details, learning based approaches build on weaker assumptions and can benefit from efficient implicit representations. We adopt such a representation and explore how the motion flow between two consecutive frames can contribute to the shape completion task. In order to effectively exploit the flow information, our architecture combines both estimations and implements two features for robustness: First, an all-to-all attention module that encodes the correlation between points in the same frame and between corresponding points in different frames; Second, a coarse-dense to fine-sparse strategy that balances the representation ability and the computational cost. Our experiments demonstrate that the flow actually benefits human body model completion. They also show that our method outperforms the state-of-the-art approaches for shape completion on 2 benchmarks, considering different human shapes, poses, and clothing.
Fichier principal
Vignette du fichier
CVPR2023ShapeFlow_mainpaper.pdf (7.12 Mo) Télécharger le fichier
CVPR2023_supmat.pdf (5.01 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04045719 , version 1 (20-04-2023)

Identifiants

Citer

Boyao Zhou, Di Meng, Jean-Sébastien Franco, Edmond Boyer. Human Body Shape Completion with Implicit Shape and Flow Learning. CVPR 2023 - IEEE Conference on Computer Vision and Pattern Recognition, Jun 2023, Vancouver, Canada. ⟨10.1109/cvpr52729.2023.01240⟩. ⟨hal-04045719⟩
247 Consultations
256 Téléchargements

Altmetric

Partager

More