ALMNet: Adjacent Layer Driven Multiscale Features for Salient Object Detection
Ashish Kumar Gupta, Ayan Seal, Pritee Khanna, Enrique Herrera‐Viedma, Ondřej Krejcar
Abstract
Nowadays, the usage of deep learning-based approaches for salient object detection (SOD) is increasing exponentially to detect and localize visually distinct regions in static images. However, the variability in scales of salient objects requires further attention given the abstract nature of the multi-layer feature hierarchy of convolution neural networks (CNNs). Firstly, feature maps of different layers in CNNs embed abstract information about objects that changes with the object’s scale. Secondly, the progressive feature fusion in models such as the feature pyramid network loses its effectiveness in detecting sharp boundaries due to the late fusion of detailed features. This work proposes two modules namely, adjacent layer attention block and partial encoder-decoder block to handle the aforementioned issues. The proposed adjacent layer attention block facilitates communication among the layers of closest abstraction to mine abundant scale features at the current resolution. The resultant integrated feature at a resolution contains detailed as well as semantic information from interaction among the adjacent layers useful to extract scale information of complex objects. A partial encoder-decoder module utilizes the resolution-specific integrated features from the adjacent layer attention block of its corresponding encoder to generate multi-scale features, and fuse them in an top-down manner. This level-specific distribution of aggregated features within a partial encoder-decoder helps coarser-layers of the network to acquire boundary information. Experimental results on five broadly used salient object detection datasets are compared with recent 20 state-of-the-art SOD models. The proposed method performs favorably against its competitors without any pre-processing or post-processing.