Litcius/Paper detail

Rethinking the U-Shape Structure for Salient Object Detection

Jiangjiang Liu, Zhiang Liu, Pai Peng, Ming‐Ming Cheng

2021IEEE Transactions on Image Processing50 citationsDOI

Abstract

The U-shape structure has shown its advantage in salient object detection for efficiently combining multi-scale features. However, most existing U-shape-based methods focused on improving the bottom-up and top-down pathways while ignoring the connections between them. This paper shows that we can achieve the cross-scale information interaction by centralizing these connections, hence obtaining semantically stronger and positionally more precise features. To inspire the newly proposed strategy's potential, we further design a relative global calibration module that can simultaneously process multi-scale inputs without spatial interpolation. Our approach can aggregate features more effectively while introducing only a few additional parameters. Our approach can cooperate with various existing U-shape-based salient object detection methods by substituting the connections between the bottom-up and top-down pathways. Experimental results demonstrate that our proposed approach performs favorably against the previous state-of-the-arts on five widely used benchmarks with less computational complexity. The source code will be publicly available.

Topics & Concepts

SalientComputer scienceAggregate (composite)Interpolation (computer graphics)Top-down and bottom-up designObject detectionObject (grammar)Process (computing)Scale (ratio)Artificial intelligenceCode (set theory)Source codeComputer visionData miningPattern recognition (psychology)AlgorithmImage (mathematics)Materials sciencePhysicsSet (abstract data type)Programming languageOperating systemComposite materialQuantum mechanicsSoftware engineeringVisual Attention and Saliency DetectionAdvanced Image and Video Retrieval TechniquesFace Recognition and Perception
Rethinking the U-Shape Structure for Salient Object Detection | Litcius