Multi-masks Generation for Increasing Robustness of Dense Direct Methods - Inria - Institut national de recherche en sciences et technologies du numérique Accéder directement au contenu
Communication Dans Un Congrès Année : 2023

Multi-masks Generation for Increasing Robustness of Dense Direct Methods

Résumé

In this paper, we address the problem of increasing the precision of dense direct stereo visual odometry methods. Dense methods need a dense depth map to generate warped images (virtual views) that will match with reference images if the estimated pose is good. Previous works have shown that generating the depth map by machine learning methods leads to very good odometry results. However, machine learning methods generate hallucinated depths even in areas where it is impossible to estimate the depth due to several reasons, like occlusions, homogeneous areas, etc. Generally, this produces wrong depth estimation that leads to errors in odometry estimation. To avoid this problem, we propose a new approach to generate multiple masks that will be combined to discard wrong pixels and therefore increase the accuracy of visual odometry. Our key contribution is to use the multiple masks not only in the odometry computation but also to improve the learning of the neural network for depth map generation. Experiments on several datasets show that masked dense direct stereo visual odometry provides much more accurate results than previous approaches in the literature.
Fichier principal
Vignette du fichier
ITSC2023-Ziming.pdf (2.33 Mo) Télécharger le fichier
IROS23-Ziming.pdf (2.34 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04227583 , version 1 (03-10-2023)

Licence

Paternité

Identifiants

  • HAL Id : hal-04227583 , version 1

Citer

Ziming Liu, Ezio Malis, Philippe Martinet. Multi-masks Generation for Increasing Robustness of Dense Direct Methods. ITSC 2023 - 26th IEEE International Conference on Intelligent Transportation Systems, IEEE-ITSS, Sep 2023, Bilbao, Spain. ⟨hal-04227583⟩
101 Consultations
62 Téléchargements

Partager

Gmail Facebook X LinkedIn More