Category-Specific Prototype Self-Refinement Contrastive Learning for Few-Shot Hyperspectral Image Classification
Quanyong Liu, Jiangtao Peng, Na Chen, Weiwei Sun, Yujie Ning, Qian Du
Abstract
Deep learning has been extensively used for hyperspectral image (HSI) classification with significant success, but the classification of high-dimensional HSI datasets with a limited amount of labeled samples is still a great challenge. Few-shot learning (FSL) has shown excellent performance in solving small-sample classification problems. However, most of the existing FSL methods usually suffer from the prototype instability and domain shift. In order to address these problems, this paper proposes a category-specific prototype self-refinement contrastive learning (CPSRCL) method for cross-domain FSL of HSIs. Our method uses a supervised contrastive learning (SCL) strategy to promote intra-class compactness and inter-class dispersion of features in the metric space. To stabilize and refine the prototypes of the support set, a category-specific prototype self-refinement (CSPSR) module is designed to adaptively learn different updating rules for different category prototypes using rich labeled information in the query set. Furthermore, a local discriminative domain adaptation (LDDA) method is constructed to align the global distribution between source and target domains while preserving domain-specific discriminative information. Experimental results on four public HSI datasets demonstrate that CPSRCL outperforms existing FSL and deep learning methods for HSI classification.