mlsanityData to 7 Oct 2026

Attention-based Dual Supervised Decoder for RGBD Semantic Segmentation

arXiv 2201.01427 ↗First posted 5 Jan 2022cs.CV eess.IVcited by 6

Not on the map. Why?

Abstract (arXiv)

Encoder-decoder models have been widely used in RGBD semantic segmentation, and most of them are designed via a two-stream network. In general, jointly reasoning the color and geometric information from RGBD is beneficial for semantic segmentation. However, most existing approaches fail to comprehensively utilize multimodal information in both the encoder and decoder. In this paper, we propose a novel attention-based dual supervised decoder for RGBD semantic segmentation. In the encoder, we design a simple yet effective attention-based multimodal fusion module to extract and fuse deeply multi-level paired complementary information. To learn more robust deep representations and rich multi-modal information, we introduce a dual-branch decoder to effectively leverage the correlations and complementary cues of different tasks. Extensive experiments on NYUDv2 and SUN-RGBD datasets demonstrate that our method achieves superior performance against the state-of-the-art methods.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Builds on 37 of its 60 references that are in the map. First posted on arXiv 5 Jan 2022.

Builds on

37 of 60 references.

References · 37

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 6,979
  4. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  5. 2017Squeeze-and-Excitation Networkscited by 4,763
  6. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  7. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
  8. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,154
  9. 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
  10. 2017Deformable Convolutional Networkscited by 1,481
  11. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,256
  12. 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
25 more
  1. 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
  2. 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
  3. 2015Learning Deconvolution Network for Semantic Segmentationcited by 365
  4. 2018PAD-Net: Multi-Tasks Guided Prediction-and-Distillation Network for Simultaneous Depth Estimation and Scene Parsingcited by 224
  5. 2015Bayesian SegNet: Model Uncertainty in Deep Convolutional Encoder-Decoder Architectures for Scene Understandingcited by 218
  6. 2018BAM: Bottleneck Attention Modulecited by 171
  7. 2017Understanding Convolution for Semantic Segmentationcited by 168
  8. 2020MTI-Net: Multi-Scale Task Interaction Networks for Multi-Task Learningcited by 157
  9. 2019Pattern-Affinitive Propagation across Depth, Surface Normal and Semantic Segmentationcited by 141
  10. 2018Concurrent Spatial and Channel Squeeze & Excitation in Fully Convolutional Networkscited by 120
  11. 2020Bi-directional Cross-Modality Feature Propagation with Separation-and-Aggregation Gate for RGB-D Semantic Segmentationcited by 120
  12. 2020Attentional Feature Fusioncited by 115
  13. 2019Depth Completion from Sparse LiDAR Data with Depth-Normal Constraintscited by 108
  14. 2019ACNet: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentationcited by 105
  15. 2020Efficient RGB-D Semantic Segmentation for Indoor Scene Analysiscited by 83
  16. 2018Depth-aware CNN for RGB-D Segmentationcited by 73
  17. 2018RedNet: Residual Encoder-Decoder Network for indoor RGB-D Semantic Segmentationcited by 65
  18. 2018Real-Time Joint Semantic Segmentation and Depth Estimation Using Asymmetric Annotationscited by 51
  19. 2020Spatial Information Guided Convolution for Real-Time RGBD Semantic Segmentationcited by 47
  20. 2019Mono-SF: Multi-View Geometry Meets Single-View Depth for Monocular Scene Flow Estimation of Dynamic Traffic Scenescited by 27
  21. 2020Malleable 2.5D Convolution: Learning Receptive Fields along the Depth-axis for RGB-D Scene Parsingcited by 24
  22. 2015Superpixel Convolutional Networks using Bilateral Inceptionscited by 23
  23. 2017Recurrent Scene Parsing with Perspective Understanding in the Loopcited by 16
  24. 2019Learning Densities in Feature Space for Reliable Segmentation of Indoor Scenescited by 8
  25. 2020Attention-guided Chained Context Aggregation for Semantic Segmentationcited by 3

Built on by

Cited by year

Citing papers per year: 2022: 1; 2023: 3; 2024: 2.

6 papers.

  1. 2023ChatBridge: Bridging Modalities with Large Language Model as a Language Catalystcited by 64
  2. 2024SDSTrack: Self-Distillation Symmetric Adapter Learning for Multi-Modal Visual Object Trackingcited by 43
  3. 2023Pixel Difference Convolutional Network for RGB-D Semantic Segmentationcited by 13
  4. 2023Impact of Pseudo Depth on Open World Object Segmentation with Minimal User Guidancecited by 4
  5. 2022Efficient Semantic Segmentation on Edge Devicescited by 1
  6. 2024CSFNet: A Cosine Similarity Fusion Network for Real-Time RGB-X Semantic Segmentation of Driving Scenescited by 1