Litcius/Paper detail

Attentive Cross-Modal Fusion Network for RGB-D Saliency Detection

Di Liu, Kao Zhang, Zhenzhong Chen

2020IEEE Transactions on Multimedia29 citationsDOI

Abstract

In this paper, an attentive cross-modal fusion (ACMF) network is proposed for RGB-D salient object detection. The proposed method selectively fuses features in a cross-modal manner and uses a fusion refinement module to fuse output features from different resolutions. Our attentive cross-modal fusion network is built based on residual attention. In each level of ResNet output, both the RGB and depth features are turned into an identity map and a weighted attention map. The identity map is reweighted by the attention map of the paired modality. Moreover, the lower level features with higher resolution are adopted to refine the boundary of detected targets. The entire architecture can be trained end-to-end. The proposed ACMF is compared with state-of-the-art methods on eight recent datasets. The results demonstrate that our model can achieve advanced performance on RGB-D salient object detection.

Topics & Concepts

Computer scienceFuse (electrical)Artificial intelligenceRGB color modelComputer visionFusionModalPattern recognition (psychology)Sensor fusionObject detectionBoundary (topology)Modality (human–computer interaction)ResidualAlgorithmMathematicsEngineeringLinguisticsElectrical engineeringChemistryPhilosophyMathematical analysisPolymer chemistryVisual Attention and Saliency DetectionAdvanced Neural Network ApplicationsFace Recognition and Perception
Attentive Cross-Modal Fusion Network for RGB-D Saliency Detection | Litcius