Efficient SonarNet: Lightweight CNN-Grafted Vision Transformer Embedding Network for Forward-Looking Sonar Image Segmentation

Abstract

While the intricate underwater environment leads to blurry and faint features of sonar targets, SonarNet has depicted great success due to its high model capabilities and multifeature fusion mechanism. However, their remarkable performance is accompanied by heavier backbones and larger model sizes to achieve benefits at the cost of increased complexity. The research on fast segmenters deployed on edge devices is urgently inquired. In this article, we analyze the current best-performing sonar image segmentation network named SonarNet. Based on the analysis, we propose a lightweight local feature grafted vision transformer (ViT) embedding network for forward-looking sonar (FLS) images called EsonarNet, which promotes a priority balance between efficiency and accuracy. EsonarNet is based on a hybrid local-global feature grafting architecture and comprises four modules. First, expand from the traditional convolutional neural network (CNN) and histogram of oriented gradients (HOG), a lightweight sonar semantic segmentation model based on hybrid CNN-transformer-HOG fusion encoding and decoding, while preserving high efficiency applied to hardware resources. Second, lightweight encoder units are employed in our EsonarNet, including a designed spatial mobile inverted bottleneck convolution (SMBConv) and efficient vision transformer (ViT) module. Third, serving as a transitional liaison between the CNN encoder and the transformer encoder, the local-global features interaction (LGFI) module focuses on dispersing local semantic information to facilitate long-distance computations, and the global-local aggregation unit (GLAU) module computes correlations through dot products to restore inductive bias. Fourth, the HOG features are introduced into EsonarNet through the lightweight HOG-deep learning graft mechanism (LHDGM) module to ensure the coherence and compatibility of the acquired traditional and abstract information with different semantics. Ultimately, experimental results demonstrate that EsonarNet outperforms other methods for FLS image segmentation in efficiency.

Topics & Concepts