Litcius/Paper detail

C$^{2}$DFNet: Criss-Cross Dynamic Filter Network for RGB-D Salient Object Detection

Miao Zhang, Shunyu Yao, Beiqi Hu, Yongri Piao, Wei Ji

2022IEEE Transactions on Multimedia117 citationsDOI

Abstract

The ability to deal with intra and inter-modality features has been critical to the development of RGB-D salient object detection. While many works have advanced in leaps and bounds in this field, most existing methods have not taken their way down into the inherent differences between the RGB and depth data due to widely adopted conventional convolution in which fixed parameter kernels are applied during inference. To promote intra and inter-modality interaction conditioned on various scenarios, as RGB and depth data are processed independently and later fused interactively, we develop a new insight and a better model. In this paper, we introduce a criss-cross dynamic filter network by decoupling dynamic convolution. First, we propose a Model-specific Dynamic Enhanced Module (MDEM) that dynamically enhances the intra-modality features with global context guidance. Second, we propose a Scene-aware Dynamic Fusion Module (SDFM) to realize dynamic feature selection between two modalities. As a result, our model achieves accurate predictions of salient objects. Extensive experiments demonstrate that our method achieves competitive performance over 28 state-of-the-art RGB-D methods on 7 public datasets.

Topics & Concepts

Computer scienceArtificial intelligenceRGB color modelComputer visionContext (archaeology)Convolution (computer science)Modality (human–computer interaction)Filter (signal processing)SalientPattern recognition (psychology)Artificial neural networkBiologyPaleontologyVisual Attention and Saliency DetectionFace Recognition and PerceptionVirtual Reality Applications and Impacts
C$^{2}$DFNet: Criss-Cross Dynamic Filter Network for RGB-D Salient Object Detection | Litcius