Are Large-Scale 3D Models Really Necessary for Accurate Visual Localization? - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Journal Articles IEEE Transactions on Pattern Analysis and Machine Intelligence Year : 2019

Are Large-Scale 3D Models Really Necessary for Accurate Visual Localization?

Abstract

Accurate visual localization is a key technology for autonomous navigation. 3D structure-based methods employ 3D models of the scene to estimate the full 6 degree-of-freedom (DOF) pose of a camera very accurately. However, constructing (and extending) large-scale 3D models is still a significant challenge. In contrast, 2D image retrieval-based methods only require a database of geo-tagged images, which is trivial to construct and to maintain. They are often considered inaccurate since they only approximate the positions of the cameras. Yet, the exact camera pose can theoretically be recovered when enough relevant database images are retrieved. In this paper, we demonstrate experimentally that large-scale 3D models are not strictly necessary for accurate visual localization. We create reference poses for a large and challenging urban dataset. Using these poses, we show that combining image-based methods with local reconstructions results in a higher pose accuracy compared to state-of-the-art structure-based methods, albeight at higher run-time costs. We show that some of these run-time costs can be alleviated by exploiting known database image poses. Our results suggest that we might want to reconsider the need for large-scale 3D models in favor of more local models, but also that further research is necessary to accelerate the local reconstruction process.
Fichier principal
Vignette du fichier
2019_PAMI_Torii_3D4Loc.pdf (30.43 Mo) Télécharger le fichier
Origin : Files produced by the author(s)
Loading...

Dates and versions

hal-02448029 , version 1 (21-01-2020)

Identifiers

Cite

Akihiko Torii, Hajime Taira, Josef Sivic, Marc Pollefeys, Masatoshi Okutomi, et al.. Are Large-Scale 3D Models Really Necessary for Accurate Visual Localization?. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2019, XX, ⟨10.1109/TPAMI.2019.2941876⟩. ⟨hal-02448029⟩
74 View
168 Download

Altmetric

Share

Gmail Facebook X LinkedIn More