A Lightweight Feature Enhancement Model for Infrared Small Target Detection

Abstract

Infrared small target detection (IRSTD) is a critical yet challenging task due to low target-background contrast, minimal target texture, and high noise levels. While data-driven methods have significantly advanced performance, persistent challenges remain. Traditional pooling schemes in multiscale networks often sacrifice crucial details necessary for detecting small targets, and existing attention mechanisms struggle to balance performance with computational efficiency. To address these challenges, we propose the hybrid feature mining network (HFMNet), a lightweight and efficient model designed to enhance feature representation for IRSTD. First, to reduce detailed loss caused by conventional pooling—which can amplify noise (e.g., max pooling) or suppress contrast (e.g., average pooling)—we introduce the cross-pooling shallow enhancement module (CSEM). By integrating diverse pooling strategies across parallel shallow streams, CSEM preserves fine details, improves localization, and prevents target loss in deeper layers. Second, for efficient local-global context modeling, we propose the hybrid feature mining module (HFMM). This module combines local and global attention by decomposing large 2-D convolutions into coupled 1-D convolutions and incorporating dilated convolutions, broadening the receptive field while reducing complexity. Coupled with the vision state-space module (VSSM) for global context modeling, HFMM effectively integrates local and global information to enhance detection performance. The effectiveness of our HFMNet has been evaluated on four benchmark datasets. In comparison to other state-of-the-art (SOTA) methods, the <inline-formula xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink"> <tex-math notation="LaTeX">${P}_{d}$ </tex-math></inline-formula> reaches 92.52% on the IRSTD-1K dataset and 99.08% on the NUAA-SIRST dataset, with only 6.09M parameters, making it a promising lightweight solution for IRSTD applications. The code will be released at <uri xmlns:mml="http://www.w3.org/1998/Math/MathML" xmlns:xlink="http://www.w3.org/1999/xlink">https://github.com/Fortuneteller6/HFMNet</uri>.

Topics & Concepts