Enhancing Contrastive Learning With Positive Pair Mining for Few-Shot Hyperspectral Image Classification - Inria - Institut national de recherche en sciences et technologies du numérique
Article Dans Une Revue IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing Année : 2024

Enhancing Contrastive Learning With Positive Pair Mining for Few-Shot Hyperspectral Image Classification

Résumé

In recent years, deep learning has emerged as the dominant approach for hyperspectral image (HSI) classification. However, deep neural networks require large annotated datasets to generalize well. This limits the applicability of deep learning for real-world HSI classification problems, as manual labeling of thousands of pixels per scene is costly and time consuming. In this article, we tackle the problem of few-shot HSI classification by leveraging state-of-the-art self-supervised contrastive learning with an improved view-generation approach. Traditionally, contrastive learning algorithms heavily rely on hand-crafted data augmentations tailored for natural imagery to generate positive pairs. However, these augmentations are not directly applicable to HSIs, limiting the potential of self-supervised learning in the hyperspectral domain. To overcome this limitation, we introduce two positive pair-mining strategies for contrastive learning on HSIs. The proposed strategies mitigate the need for high-quality data augmentations, providing an effective solution for few-shot HSI classification. Through extensive experiments, we show that the proposed approach improves accuracy and label efficiency on four popular HSI classification benchmarks. Furthermore, we conduct a thorough analysis of the impact of data augmentation in contrastive learning, highlighting the advantage of our positive pair-mining approach.
Fichier principal
Vignette du fichier
Enhancing_Contrastive_Learning_With_Positive_Pair_Mining_for_Few-Shot_Hyperspectral_Image_Classification.pdf (15.76 Mo) Télécharger le fichier
Origine Fichiers produits par l'(les) auteur(s)
Licence

Dates et versions

hal-04847155 , version 1 (18-12-2024)

Licence

Identifiants

Citer

Nassim Ait Ali Braham, Julien Mairal, Jocelyn Chanussot, Lichao Mou, Xiao Xiang Zhu. Enhancing Contrastive Learning With Positive Pair Mining for Few-Shot Hyperspectral Image Classification. IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing, 2024, 17, pp.8509-8526. ⟨10.1109/JSTARS.2024.3371909⟩. ⟨hal-04847155⟩
0 Consultations
0 Téléchargements

Altmetric

Partager

More