Model-image registration of a building’s facade based on dense semantic segmentation - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles Computer Vision and Image Understanding Year : 2021

Model-image registration of a building’s facade based on dense semantic segmentation

Abstract

This article presents an efficient approach for accurate registration of a building facade model "dressed" with dense semantic information. Localization sensors such as the GPS as well as vision-based methods are able to provide a camera pose in an efficient and stable way, but at the expense of low accuracy. We propose here to rely on semantic maps to improve the accuracy of a rough camera pose. Simultaneously we aim to iteratively improve the quality of the semantic map through the registration. Registration and semantic segmentation are jointly refined in an Expectation-Maximization framework. We especially introduce a Bayesian model that uses prior semantic segmentation as well as geometric structure of the facade reference modeled by Generalized Gaussian Mixtures. We show the advantages of our method in terms of robustness to clutter and change of illumination on urban images from various databases.
Fichier principal
Vignette du fichier
rapport.pdf (7.23 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03204477 , version 1 (26-04-2021)

Identifiers

Cite

Antoine Fond, Marie-Odile Berger, Gilles Simon. Model-image registration of a building’s facade based on dense semantic segmentation. Computer Vision and Image Understanding, 2021, 206, pp.103185. ⟨10.1016/j.cviu.2021.103185⟩. ⟨hal-03204477⟩
145 View
376 Download

Altmetric

Share

Gmail Mastodon Facebook X LinkedIn More