CRFNet: A Deep Convolutional Network to Learn the Potentials of a CRF for the Semantic Segmentation of Remote Sensing Images - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue IEEE Transactions on Geoscience and Remote Sensing Année : 2024

CRFNet: A Deep Convolutional Network to Learn the Potentials of a CRF for the Semantic Segmentation of Remote Sensing Images

Résumé

This paper presents a method for the automatic learning of the potentials of a stochastic model, in particular a conditional random field (CRF), in a non-parametric fashion. The proposed model is based on a neural architecture, in order to leverage the modeling capabilities of deep learning approaches to directly learn semantic and spatial information from the input data. Specifically, the methodology is based on fully convolutional networks and fully connected neural networks. The idea is to access the multiscale information intrinsically extracted in the intermediate layers of a fully convolutional network through the integration of fully connected neural networks at different scales, while favoring the interpretability of the hidden layers as posterior probabilities. The potentials of the CRF are learned through an additional convolutional layer, whose kernel models the local spatial information considered. The loss function is computed as a linear combination of cross-entropy losses, accounting for the multiscale and the spatial information. To evaluate the capabilities of the proposed approach for the semantic segmentation of remote sensing images, the experimental validation was conducted with the ISPRS 2D Semantic Labeling Challenge Vaihingen and Potsdam datasets and with the IEEE GRSS Data Fusion Contest Zeebruges dataset. As the ground truths of these benchmark datasets are spatially exhaustive, they have been modified to approximate the spatially sparse ground truths common in real remote sensing applications. The results are significant, as the proposed approach obtains higher average classification accuracies than recent state-of-theart techniques considered in this paper. The code is available at https://github.com/Ayana-Inria/CRFNet-RS.

Index Terms-semantic
Fichier principal
Vignette du fichier
CRFNet_A_Deep_Convolutional_Network_to_Learn_the_Potentials_of_a_CRF_for_the_Semantic_Segmentation_of_Remote_Sensing_Images.pdf (18.29 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-04683326 , version 1 (01-09-2024)

Licence

Identifiants

Citer

Martina Pastorino, Gabriele Moser, Sebastiano B. Serpico, Josiane Zerubia. CRFNet: A Deep Convolutional Network to Learn the Potentials of a CRF for the Semantic Segmentation of Remote Sensing Images. IEEE Transactions on Geoscience and Remote Sensing, 2024, pp.1-19. ⟨10.1109/tgrs.2024.3452631⟩. ⟨hal-04683326⟩
44 Consultations
21 Téléchargements

Altmetric

Partager

More