Modality-Guided Subnetwork for Salient Object Detection
Not on the map. Why?
Abstract (arXiv)
Recent RGBD-based models for saliency detection have attracted research attention. The depth clues such as boundary clues, surface normal, shape attribute, etc., contribute to the identification of salient objects with complicated scenarios. However, most RGBD networks require multi-modalities from the input side and feed them separately through a two-stream design, which inevitably results in extra costs on depth sensors and computation. To tackle these inconveniences, we present in this paper a novel fusion design named modality-guided subnetwork (MGSnet). It has the following superior designs: 1) Our model works for both RGB and RGBD data, and dynamically estimating depth if not available. Taking the inner workings of depth-prediction networks into account, we propose to estimate the pseudo-geometry maps from RGB input - essentially mimicking the multi-modality input. 2) Our MGSnet for RGB SOD results in real-time inference but achieves state-of-the-art performance compared to other RGB models. 3) The flexible and lightweight design of MGS facilitates the integration into RGBD two-streaming models. The introduced fusion design enables a cross-modality interaction to enable further progress but with a minimal cost.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 23 of its 39 references that are in the map. First posted on arXiv 10 Oct 2021.
Builds on
23 of 39 references.
References · 23
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2017Deformable Convolutional Networkscited by 1,488
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2019EGNet:Edge Guidance Network for Salient Object Detectioncited by 237
- 2019Cascaded Partial Decoder for Fast and Accurate Salient Object Detectioncited by 216
- 2019A Simple Pooling-Based Design for Real-Time Salient Object Detectioncited by 212
- 2017Receptive Field Block Net for Accurate and Fast Object Detectioncited by 141
- 2019Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarkscited by 133
- 2020JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object Detectioncited by 79
11 more
- 2020Hierarchical Dynamic Filtering Network for RGB-D Salient Object Detectioncited by 72
- 2020A Single Stream Network for Robust and Real-time RGB-D Salient Object Detectioncited by 67
- 2021Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusioncited by 56
- 2016Deep Contrast Learning for Salient Object Detectioncited by 52
- 2020Accurate RGB-D Salient Object Detection via Collaborative Learningcited by 52
- 2020RGB-D Salient Object Detection with Cross-Modality Modulation and Selectioncited by 50
- 2020Spatial Information Guided Convolution for Real-Time RGBD Semantic Segmentationcited by 48
- 2017Learning Uncertain Convolutional Features for Accurate Saliency Detectioncited by 44
- 2020Is Depth Really Necessary for Salient Object Detection?cited by 23
- 2018PDNet: Prior-model Guided Depth-enhanced Network for Salient Object Detectioncited by 21
- 2020Depth-Adapted CNN for RGB-D camerascited by 12
Built on by
Citing papers per year: 2022: 3; 2023: 3; 2024: 0; 2025: 2.
8 papers.
- 2022Source-free Depth for Object Pop-outcited by 52
- 2022RGB-Event Fusion for Moving Object Detection in Autonomous Drivingcited by 40
- 2023HiDAnet: RGB-D Salient Object Detection via Hierarchical Depth Awarenesscited by 31
- 2023HRTransNet: HRFormer-Driven Two-Modality Salient Object Detectioncited by 27
- 2022Robust RGB-D Fusion for Saliency Detectioncited by 12
- 2023Object Segmentation by Mining Cross-Modal Semanticscited by 12
- 2025PDDM: Pseudo Depth Diffusion Model for RGB-PD Semantic Segmentation Based in Complex Indoor Scenescited by 2
- 2025Mamba-based Spatio-Frequency Motion Perception for Video Camouflaged Object Detectioncited by 0
- 2025Mamba-based Spatio-Frequency Motion Perception for Video Camouflaged Object Detection31 Jul 2025
- 2025PDDM: Pseudo Depth Diffusion Model for RGB-PD Semantic Segmentation Based in Complex Indoor Scenes24 Mar 2025
- 2023Object Segmentation by Mining Cross-Modal Semantics17 May 2023
- 2023HiDAnet: RGB-D Salient Object Detection via Hierarchical Depth Awareness18 Jan 2023
- 2023HRTransNet: HRFormer-Driven Two-Modality Salient Object Detection8 Jan 2023
- 2022Source-free Depth for Object Pop-out10 Dec 2022
- 2022RGB-Event Fusion for Moving Object Detection in Autonomous Driving17 Sep 2022
- 2022Robust RGB-D Fusion for Saliency Detection2 Aug 2022