Learning joint shape and appearance representations with metamorphic auto-encoders - Inria - Institut national de recherche en sciences et technologies du numérique
Conference Papers Year : 2020

Learning joint shape and appearance representations with metamorphic auto-encoders

Abstract

Transformation-based methods for shape analysis offer a consistent framework to model the geometrical content of images. Most often relying on diffeomorphic transforms, they lack however the ability to properly handle texture and differing topological content. Conversely, modern deep learning methods offer a very efficient way to analyze image textures. Building on the theory of metamorphoses, which models images as combined intensity-domain and spatial-domain transforms of a prototype, we introduce the "metamorphic" auto-encoding architecture. This class of neural networks is interpreted as a Bayesian generative and hierarchical model, allowing the joint estimation of the network parameters, a representative prototype of the training images, as well as the relative importance between the geometrical and texture contents. We give arguments for the practical relevance of the learned prototype and Euclidean latent-space metric, achieved thanks to an explicit normalization layer. Finally, the ability of the proposed architecture to learn joint and relevant shape and appearance representations from image collections is illustrated on BraTs 2018 datasets, showing in particular an encouraging step towards personalized numerical simulation of tumors with data-driven models.
Fichier principal
Vignette du fichier
paper1290.pdf (2.47 Mo) Télécharger le fichier
supplementary1290.pdf (192.49 Ko) Télécharger le fichier
Origin Files produced by the author(s)
Origin Files produced by the author(s)

Dates and versions

hal-03136537 , version 1 (09-02-2021)

Identifiers

  • HAL Id : hal-03136537 , version 1

Cite

Alexandre Bône, Paul Vernhet, Olivier Colliot, Stanley Durrleman​. Learning joint shape and appearance representations with metamorphic auto-encoders. MICCAI 2020 - 23rd International Conference on Image Computing and Computer Assisted Interventions, Oct 2020, Lima / Virtual, Peru. ⟨hal-03136537⟩
86 View
451 Download

Share

More