XDvision: Dense outdoor perception for autonomous vehicles - Inria - Institut national de recherche en sciences et technologies du numérique Access content directly
Conference Papers Year : 2017

XDvision: Dense outdoor perception for autonomous vehicles


Robust perception is the cornerstone of safe and environmentally-aware autonomous navigation systems. Autonomous robots are expected to recognise the objects in their surroundings under a wide range of challenging environmental conditions. This problem has been tackled by combining multiple sensor modalities that have complementary characteristics. This paper proposes an approach to multi-sensor-based robotic perception that leverages the rich and dense appearance information provided by camera sensors, and the range data provided by active sensors independently of how dense their measurements are. We introduce a framework we call XDvision where colour images are augmented with dense depth information obtained from sparser sensors such as lidars. We demonstrate the utility of our framework by comparing the performance of a standard CNN-based image classifier fed with image data only with the performance of a two-layer multimodal CNN trained using our augmented representation.
No file

Dates and versions

hal-01672089 , version 1 (23-12-2017)



Víctor Romero-Cano, Nicolas Vignard, Christian Laugier. XDvision: Dense outdoor perception for autonomous vehicles. IEEE Intelligent Vehicle conference 2017 (IV 2017), Jun 2017, Redondo Beach, Los Angeles, United States. ⟨10.1109/IVS.2017.7995807⟩. ⟨hal-01672089⟩
173 View
0 Download



Gmail Facebook X LinkedIn More