mlsanityData to 14 Oct 2026

SwinNet: Swin Transformer drives edge-aware RGB-D and RGB-T salient object detection

arXiv 2204.05585 ↗First posted 12 Apr 2022cs.CVcited by 59

Not on the map. Why?

Abstract (arXiv)

Convolutional neural networks (CNNs) are good at extracting contexture features within certain receptive fields, while transformers can model the global long-range dependency features. By absorbing the advantage of transformer and the merit of CNN, Swin Transformer shows strong feature representation ability. Based on it, we propose a cross-modality fusion model SwinNet for RGB-D and RGB-T salient object detection. It is driven by Swin Transformer to extract the hierarchical features, boosted by attention mechanism to bridge the gap between two modalities, and guided by edge information to sharp the contour of salient object. To be specific, two-stream Swin Transformer encoder first extracts multi-modality features, and then spatial alignment and channel re-calibration module is presented to optimize intra-level cross-modality features. To clarify the fuzzy boundary, edge-guided decoder achieves inter-level cross-modality fusion under the guidance of edge features. The proposed model outperforms the state-of-the-art models on RGB-D and RGB-T datasets, showing that it provides more insight into the cross-modality complementarity task.

Key facts. Cited by 59 papers in the map (data through 14 Oct 2026). Builds on 50 of its 98 references that are in the map. First posted on arXiv 12 Apr 2022.

Builds on

50 of 98 references.

References · 50

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  4. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,962
  7. 2021Vision Transformers for Dense Predictioncited by 1,803
  8. 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,558
  9. 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,101
  10. 2021CvT: Introducing Convolutions to Vision Transformerscited by 947
  11. 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
  12. 2019Res2Net: A New Multi-scale Backbone Architecturecited by 470
38 more
  1. 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
  2. 2021Visual Saliency Transformercited by 175
  3. 2019Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarkscited by 133
  4. 2015Salient Object Detection: A Benchmarkcited by 131
  5. 2020UC-Net: Uncertainty Inspired RGB-D Saliency Detection via Conditional Variational Autoencoderscited by 98
  6. 2019Towards High-Resolution Salient Object Detectioncited by 92
  7. 2021CAT: Cross Attention in Vision Transformercited by 92
  8. 2020JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object Detectioncited by 79
  9. 2020RGBT Salient Object Detection: A Large-scale Dataset and Benchmarkcited by 69
  10. 2020A Single Stream Network for Robust and Real-time RGB-D Salient Object Detectioncited by 67
  11. 2020Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Imagescited by 61
  12. 2018Review of Visual Saliency Detection with Comprehensive Informationcited by 60
  13. 2019RGB-T Image Saliency Detection via Collaborative Graph Learningcited by 58
  14. 2021Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusioncited by 56
  15. 2020Accurate RGB-D Salient Object Detection via Collaborative Learningcited by 52
  16. 2017A Unified RGB-T Saliency Detection Benchmark: Dataset, Baselines, Analysis and A Novel Approachcited by 51
  17. 2019Nested Network with Two-Stream Pyramid for Salient Object Detection in Optical Remote Sensing Imagescited by 51
  18. 2020RGB-D Salient Object Detection with Cross-Modality Modulation and Selectioncited by 50
  19. 2020DPANet: Depth Potentiality-Aware Gated Attention Network for RGB-D Salient Object Detectioncited by 45
  20. 2020Multi-interactive Dual-decoder for RGB-thermal Salient Object Detectioncited by 44
  21. 2020Progressively Guided Alternate Refinement Network for RGB-D Salient Object Detectioncited by 40
  22. 2020Learning Selective Mutual Attention and Contrast for RGB-D Saliency Detectioncited by 38
  23. 2020Cascade Graph Neural Networks for RGB-D Salient Object Detectioncited by 36
  24. 2021RGB-D Salient Object Detection via 3D Convolutional Neural Networkscited by 36
  25. 2015Online Tracking by Learning Discriminative Saliency Map with Convolutional Neural Networkcited by 31
  26. 2018Non-rigid Object Tracking via Deep Multi-scale Spatial-temporal Discriminative Saliency Mapscited by 26
  27. 2019cmSalGAN: RGB-D Salient Object Detection with Cross-View Generative Adversarial Networkscited by 21
  28. 2020A Parallel Down-Up Fusion Network for Salient Object Detection in Optical Remote Sensing Imagescited by 19
  29. 2019Edge-guided Non-local Fully Convolutional Network for Salient Object Detectioncited by 16
  30. 2019SAC-Net: Spatial Attenuation Context for Salient Object Detectioncited by 15
  31. 2021BTS-Net: Bi-directional Transfer-and-Selection Network For RGB-D Salient Object Detectioncited by 15
  32. 2020Data-Level Recombination and Lightweight Fusion Scheme for RGB-D Salient Object Detectioncited by 13
  33. 2020Co-Saliency Detection with Co-Attention Fully Convolutional Networkcited by 9
  34. 2019Context-Aware Saliency Detection for Image Retargeting Using Convolutional Neural Networkscited by 7
  35. 2020DUT-LFSaliency: Versatile Dataset and Light Field-to-RGB Saliency Detectioncited by 6
  36. 2021Graph-based Pyramid Global Context Reasoning with a Saliency-aware Projection for COVID-19 Lung Infections Segmentationcited by 5
  37. 2021Saliency-Aware Class-Agnostic Food Image Segmentationcited by 4
  38. 2021CMA-Net: A Cascaded Mutual Attention Network for Light Field Salient Object Detectioncited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 7; 2023: 17; 2024: 19; 2025: 8; 2026: 8.

59 papers.

Sort:

By area:

  1. 2023VST++: Efficient and Stronger Visual Saliency Transformercited by 28
  2. 2023HRTransNet: HRFormer-Driven Two-Modality Salient Object Detectioncited by 27
  3. 2022GraphMLP: A Graph MLP-Like Architecture for 3D Human Pose Estimationcited by 21
  4. 2024Alignment-Free RGBT Salient Object Detection: Semantics-guided Asymmetric Correlation Network and A Unified Benchmarkcited by 19
  5. 2024Learning Adaptive Fusion Bank for Multi-modal Salient Object Detectioncited by 19
  6. 2023Salient Object Detection in Optical Remote Sensing Images Driven by Transformercited by 17
  7. 2022Position-Aware Relation Learning for RGB-Thermal Salient Object Detectioncited by 12
  8. 2023Object Segmentation by Mining Cross-Modal Semanticscited by 12
  9. 2023Decomposed Guided Dynamic Filters for Efficient RGB-Guided Depth Completioncited by 10
  10. 2022Panoramic Video Salient Object Detection with Ambisonic Audio Guidancecited by 9
  11. 2023Mutual Information Regularization for Weakly-supervised RGB-D Salient Object Detectioncited by 9
  12. 2023Unified-modal Salient Object Detection via Adaptive Prompt Learningcited by 9
38 more
  1. 2023Spectrum-driven Mixed-frequency Network for Hyperspectral Salient Object Detectioncited by 9
  2. 2023Scribble-Supervised RGB-T Salient Object Detectioncited by 8
  3. 2024Quality-aware Selective Fusion Network for V-D-T Salient Object Detectioncited by 8
  4. 2024METER: a mobile vision transformer architecture for monocular depth estimationcited by 7
  5. 2023Hybrid-Fusion Transformer for Multisequence MRIcited by 6
  6. 2024SSFam: Scribble Supervised Salient Object Detection Familycited by 6
  7. 2024Part-Whole Relational Fusion Towards Multi-Modal Scene Understandingcited by 6
  8. 2024MambaSOD: Dual Mamba-Driven Cross-Modal Fusion Network for RGB-D Salient Object Detectioncited by 6
  9. 2025Lightweight RGB-D Salient Object Detection from a Speed-Accuracy Tradeoff Perspectivecited by 6
  10. 2024Transformer-based RGB-T Tracking with Channel and Spatial Feature Fusioncited by 4
  11. 2024SeaDATE: Remedy Dual-Attention Transformer with Semantic Alignment via Contrast Learning for Multimodal Object Detectioncited by 4
  12. 2025KAN-SAM: Kolmogorov-Arnold Network Guided Segment Anything Model for RGB-T Salient Object Detectioncited by 4
  13. 2022Dual Swin-Transformer based Mutual Interactive Network for RGB-D Salient Object Detectioncited by 3
  14. 2022Mirror Complementary Transformer Network for RGB-thermal Salient Object Detectioncited by 3
  15. 2023ComPtr: Towards Diverse Bi-source Dense Prediction Tasks via A Simple yet General Complementary Transformercited by 3
  16. 2023Benchmarking Ultra-High-Definition Image Reflection Removalcited by 3
  17. 2023All in One: RGB, RGB-D, and RGB-T Salient Object Detectioncited by 3
  18. 2024FDiff-Fusion:Denoising diffusion fusion network based on fuzzy learning for 3D medical image segmentationcited by 3
  19. 2024AGSENet: A Robust Road Ponding Detection Method for Proactive Traffic Safetycited by 3
  20. 2025SAMSOD: Rethinking SAM Optimization for RGB-T Salient Object Detectioncited by 3
  21. 2023FMRT: Learning Accurate Feature Matching with Reconciliatory Transformercited by 2
  22. 2024Salient Object Detection From Arbitrary Modalitiescited by 2
  23. 2024Cycle-YOLO: A Efficient and Robust Framework for Pavement Damage Detectioncited by 2
  24. 2024Deep Fourier-embedded Network for RGB and Thermal Salient Object Detectioncited by 2
  25. 2024Spectrum-oriented Point-supervised Saliency Detector for Hyperspectral Imagescited by 2
  26. 2025HyPSAM: Hybrid Prompt-driven Segment Anything Model for RGB-Thermal Salient Object Detectioncited by 2
  27. 2026STENet: Superpixel Token Enhancing Network for RGB-D Salient Object Detectioncited by 2
  28. 2022Swin-transformer-yolov5 For Real-time Wine Grape Bunch Detectioncited by 1
  29. 2023CST-YOLO: A Novel Method for Blood Cell Detection Based on Improved YOLOv7 and CNN-Swin Transformercited by 1
  30. 2024A Volumetric Saliency Guided Image Summarization for RGB-D Indoor Scene Classificationcited by 1
  31. 2024Efficient Fourier Filtering Network with Contrastive Learning for AAV-based Unaligned Bimodal Salient Object Detectioncited by 1
  32. 2024IV-tuning: Parameter-Efficient Transfer Learning for Infrared-Visible Taskscited by 1
  33. 2022TANet: Transformer-based Asymmetric Network for RGB-D Salient Object Detectioncited by 0
  34. 2023HODINet: High-Order Discrepant Interaction Network for RGB-D Salient Object Detectioncited by 0
  35. 2023Channel and Spatial Relation-Propagation Network for RGB-Thermal Semantic Segmentationcited by 0
  36. 2024CSDNet: Detect Salient Object in Depth-Thermal via A Lightweight Cross Shallow and Deep Perception Networkcited by 0
  37. 2025SSNet: Saliency Prior and State Space Model-based Network for Salient Object Detection in RGB-D Imagescited by 0
  38. 2025Depth-Sensitive Soft Suppression with RGB-D Inter-Modal Stylization Flow for Domain Generalization Semantic Segmentationcited by 0

50 most cited of 59 All 59 (JSON)