DBMLLA: Double-Branch Mamba-Like Linear Attention Network for Hyperspectral Image Classification
Lianhui Liang, Peiyi Xie, Ying Zhang, Jiaxin Li, Zhe Zhang, Jun Li, Antonio Plaza
Abstract
Convolutional Neural Networks (CNNs) and Transformers have made remarkable achievements in hyperspectral image classification (HSIC). Unfortunately, CNN-based methods struggle to capture the contextual dependencies between pixels in HSIs, while Transformer-based methods suffer from quadratic computational complexity. Recently, the Mamba model has shown great potential as it can describe long-range dependencies between HSI pixels with linear computational complexity. Yet, Mamba still faces significant challenges in terms of global modeling. Inspired by the Mamba model framework and Transformers, a novel Dual-Branch Mamba-Like Linear Attention (DBMLLA) network is proposed for HSIC, achieving efficient global dependency modeling. Specifically, the proposed DBMLLA combines an embedding module, a Spatial-Spectral Mamba-Like Linear Attention (SS-MLLA) module, and a fusion module. In the embedding module, an absolute position embedding module is introduced for better extraction of global features. In the SS-MLLA module, we design the Spatial Mamba-Like Linear Attention (SpaMLLA) block and the Spectral Mamba-Like Linear Attention (SpeMLLA) block to exploit the spatial and spectral information of the HSI. In addition, SS-MLLA is improved by utilising Depthwise Separable Convolution (DSC) to enhance the model’s ability to extract deeper local feature information. Through experiments conducted on four public hyperspectral datasets, it is demonstrated that the proposed model consistently outperforms state-of-the-art approaches.