Multitask Learning for SAR Ship Detection With Gaussian-Mask Joint Segmentation

Abstract

Detecting ships from synthetic aperture radar (SAR) images is inherently subject to the limitations of SAR’s imaging mechanism. SAR object detection technology has rapidly advanced in recent years due to deep learning based techniques for detecting objects from optical images. SAR ship detection still faces some challenges due to the strong speckle noise, complex surroundings, and variety of scales. This paper proposes a multitask learning framework for object detection (MLDet) detect ships in SAR images. The proposed end-to-end framework consists of object detection task, speckle supression task and target segmentation task. Firstly, an angle classification loss with aspect ratio weighting is explored during object detection to improve the accuracy by making the detector sensitive to the periodicity of angular and the aspect ratio of objects. Secondly, the speckle supression task employs a dual-feature fusion attention mechanism to suppress noisy background information and fuse shallow features and denoising features, which helps MLDet be more robust to speckle noise. Thirdly, the target segmentation task with rotated Gaussian-mask is explored to further help the detection network to extract the regions of intersect from the cluttered background, as well as improving the detection efficiency through pixel-by-pixel prediction. The rotated Gaussian-mask for ship modeling ensures that the center of a ship has the highest probablities to be labeled as an object, and the probablities of the remaining regions are gradually reduced under a Gaussian distribution. Assisted by these two subtasks, the shallow level features are robust to speckle noise and reliably support deep level feature learning. In addition, the weighted rotated boxes fusion (WRBF) strategy is adopted to combine the predictions of multi-direction anchors for rotated objects, and eliminate the anchors beyond the boundary as well as the anchors with high overlap rates but low scores. A large number of experiments and comprehensive evaluations on SAR ship detection datasets SSDD+ and HRSID have shown the effectiveness and superiority of the proposed method. The code is available from https://github.com/zx152/MLDet.

Topics & Concepts