TriTransNet: RGB-D Salient Object Detection with a Triplet Transformer Embedding Network
Not on the map. Why?
Abstract (arXiv)
Salient object detection is the pixel-level dense prediction task which can highlight the prominent object in the scene. Recently U-Net framework is widely used, and continuous convolution and pooling operations generate multi-level features which are complementary with each other. In view of the more contribution of high-level features for the performance, we propose a triplet transformer embedding module to enhance them by learning long-range dependencies across layers. It is the first to use three transformer encoders with shared weights to enhance multi-level features. By further designing scale adjustment module to process the input, devising three-stream decoder to process the output and attaching depth features to color features for the multi-modal fusion, the proposed triplet transformer embedding network (TriTransNet) achieves the state-of-the-art performance in RGB-D salient object detection, and pushes the performance to a new level. Experimental results demonstrate the effectiveness of the proposed modules and the competition of TriTransNet.
Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 56 of its 90 references that are in the map. First posted on arXiv 9 Aug 2021.
Builds on
56 of 90 references.
References · 56
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2018CBAM: Convolutional Block Attention Modulecited by 2,463
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021TransUNet: Transformers Make Strong Encoders for Medical Image Segmentationcited by 1,552
- 2020Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformerscited by 1,368
38 more
- 2021Tokens-to-Token ViT: Training Vision Transformers from Scratch on ImageNetcited by 1,096
- 2021CvT: Introducing Convolutions to Vision Transformerscited by 946
- 2020PCT: Point cloud transformercited by 730
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2021Transformer Trackingcited by 412
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2020Visual Transformers: Token-based Image Representation and Processing for Computer Visioncited by 333
- 2021Escaping the Big Data Paradigm with Compact Transformerscited by 261
- 2021TransFuse: Fusing Transformers and CNNs for Medical Image Segmentationcited by 258
- 2021LocalViT: Analyzing Locality in Vision Transformerscited by 228
- 2021CoTr: Efficiently Bridging CNN and Transformer for 3D Medical Image Segmentationcited by 227
- 2021Co-Scale Conv-Attentional Image Transformerscited by 224
- 2019Cascaded Partial Decoder for Fast and Accurate Salient Object Detectioncited by 216
- 2021Multi-Scale Vision Longformer: A New Vision Transformer for High-Resolution Image Encodingcited by 207
- 2019F3Net: Fusion, Feedback and Focus for Salient Object Detectioncited by 176
- 2021High-Fidelity Pluralistic Image Completion with Transformerscited by 134
- 2019Rethinking RGB-D Salient Object Detection: Models, Data Sets, and Large-Scale Benchmarkscited by 133
- 2015Salient Object Detection: A Benchmarkcited by 130
- 2020UC-Net: Uncertainty Inspired RGB-D Saliency Detection via Conditional Variational Autoencoderscited by 98
- 2020JL-DCF: Joint Learning and Densely-Cooperative Fusion Framework for RGB-D Salient Object Detectioncited by 79
- 2021Line Segment Detection Using Transformers without Edgescited by 73
- 2020Hierarchical Dynamic Filtering Network for RGB-D Salient Object Detectioncited by 72
- 2020A Single Stream Network for Robust and Real-time RGB-D Salient Object Detectioncited by 67
- 2021Deep RGB-D Saliency Detection with Depth-Sensitive Attention and Automatic Multi-Modal Fusioncited by 56
- 2020Accurate RGB-D Salient Object Detection via Collaborative Learningcited by 52
- 2020RGB-D Salient Object Detection with Cross-Modality Modulation and Selectioncited by 50
- 2020DPANet: Depth Potentiality-Aware Gated Attention Network for RGB-D Salient Object Detectioncited by 45
- 2020Progressively Guided Alternate Refinement Network for RGB-D Salient Object Detectioncited by 40
- 2020Real-time Fusion Network for RGB-D Semantic Segmentation Incorporating Unexpected Obstacle Detection for Road-driving Imagescited by 36
- 2021RGB-D Salient Object Detection via 3D Convolutional Neural Networkscited by 36
- 2020Bilateral Attention Network for RGB-D Salient Object Detectioncited by 35
- 2015Online Tracking by Learning Discriminative Saliency Map with Convolutional Neural Networkcited by 31
- 2021End-to-End Trainable Multi-Instance Pose Estimation with Transformerscited by 30
- 2019Adaptive Fusion for RGB-D Salient Object Detectioncited by 29
- 2018Non-rigid Object Tracking via Deep Multi-scale Spatial-temporal Discriminative Saliency Mapscited by 26
- 2020MobileSal: Extremely Efficient RGB-D Salient Object Detectioncited by 25
- 2020Is Depth Really Necessary for Salient Object Detection?cited by 23
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2021: 3; 2022: 10; 2023: 12; 2024: 8; 2025: 8; 2026: 4.
45 papers.
Sort:
By area:
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
- 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detectioncited by 57
- 2021CAVER: Cross-Modal View-Mixed Transformer for Bi-Modal Salient Object Detectioncited by 47
- 2024GeminiFusion: Efficient Pixel-wise Multimodal Fusion for Vision Transformercited by 42
- 2023HiDAnet: RGB-D Salient Object Detection via Hierarchical Depth Awarenesscited by 31
- 2023HRTransNet: HRFormer-Driven Two-Modality Salient Object Detectioncited by 27
- 2023Point-aware Interaction and CNN-induced Refinement Network for RGB-D Salient Object Detectioncited by 25
- 2024Fantastic Animals and Where to Find Them: Segment Any Marine Animal with Dual SAMcited by 23
- 2023Towards Diverse Binary Segmentation via A Simple yet General Gated Networkcited by 17
- 2023Salient Object Detection in Optical Remote Sensing Images Driven by Transformercited by 17
- 2024MAS-SAM: Segment Any Marine Animal with Aggregated Featurescited by 15
- 2022Weakly Supervised Video Salient Object Detection via Point Supervisioncited by 13
33 more
- 2022Robust RGB-D Fusion for Saliency Detectioncited by 12
- 2023Object Segmentation by Mining Cross-Modal Semanticscited by 12
- 2023Salient Object Detection in RGB-D Videoscited by 8
- 2024Quality-aware Selective Fusion Network for V-D-T Salient Object Detectioncited by 8
- 2022GroupTransNet: Group Transformer Network for RGB-D Salient Object Detectioncited by 7
- 2023Co-Salient Object Detection with Semantic-Level Consensus Extraction and Dispersioncited by 6
- 2023Hybrid-Fusion Transformer for Multisequence MRIcited by 6
- 2024ViDSOD-100: A New Dataset and a Baseline Model for RGB-D Video Salient Object Detectioncited by 6
- 2024MambaSOD: Dual Mamba-Driven Cross-Modal Fusion Network for RGB-D Salient Object Detectioncited by 6
- 2025Lightweight RGB-D Salient Object Detection from a Speed-Accuracy Tradeoff Perspectivecited by 6
- 2021MutualFormer: Multi-Modality Representation Learning via Cross-Diffusion Attentioncited by 5
- 2022DFTR: Depth-supervised Fusion Transformer for Salient Object Detectioncited by 5
- 2022Dual Swin-Transformer based Mutual Interactive Network for RGB-D Salient Object Detectioncited by 3
- 2022Mirror Complementary Transformer Network for RGB-thermal Salient Object Detectioncited by 3
- 2023ComPtr: Towards Diverse Bi-source Dense Prediction Tasks via A Simple yet General Complementary Transformercited by 3
- 2025WXSOD: A Benchmark for Robust Salient Object Detection in Adverse Weather Conditionscited by 3
- 2021MFEViT: A Robust Lightweight Transformer-based Network for Multimodal 2D+3D Facial Expression Recognitioncited by 2
- 2024Depth-guided Texture Diffusion for Image Semantic Segmentationcited by 2
- 2024Deep Fourier-embedded Network for RGB and Thermal Salient Object Detectioncited by 2
- 2025LEAF-Mamba: Local Emphatic and Adaptive Fusion State Space Model for RGB-D Salient Object Detectioncited by 2
- 2026STENet: Superpixel Token Enhancing Network for RGB-D Salient Object Detectioncited by 2
- 2026OmniFood8K: Single-Image Nutrition Estimation via Hierarchical Frequency-Aligned Fusioncited by 2
- 2022SiaTrans: Siamese Transformer Network for RGB-D Salient Object Detection with Depth Image Classificationcited by 1
- 2025DMTrack: Spatio-Temporal Multimodal Tracking via Dual-Adaptercited by 1
- 2022TANet: Transformer-based Asymmetric Network for RGB-D Salient Object Detectioncited by 0
- 2022Depth Quality-Inspired Feature Manipulation for Efficient RGB-D and Video Salient Object Detectioncited by 0
- 2023HODINet: High-Order Discrepant Interaction Network for RGB-D Salient Object Detectioncited by 0
- 2025Dual Mutual Learning Network with Global-local Awareness for RGB-D Salient Object Detectioncited by 0
- 2025Unleashing the Power of Motion and Depth: A Selective Fusion Strategy for RGB-D Video Salient Object Detectioncited by 0
- 2025Towards Size-invariant Salient Object Detection: A Generic Evaluation and Optimization Approachcited by 0
- 2025DualGazeNet: A Biologically Inspired Dual-Gaze Query Network for Salient Object Detectioncited by 0
- 2026HFP-SAM: Hierarchical Frequency Prompted SAM for Efficient Marine Animal Segmentationcited by 0
- 2026Learning Spatially Adaptive Structural Coordination for Underwater Salient Object Detectioncited by 0
- 2026Learning Spatially Adaptive Structural Coordination for Underwater Salient Object Detection15 May 2026
- 2026OmniFood8K: Single-Image Nutrition Estimation via Hierarchical Frequency-Aligned Fusion14 Apr 2026
- 2026STENet: Superpixel Token Enhancing Network for RGB-D Salient Object Detection23 Mar 2026
- 2026HFP-SAM: Hierarchical Frequency Prompted SAM for Efficient Marine Animal Segmentation13 Mar 2026
- 2025DualGazeNet: A Biologically Inspired Dual-Gaze Query Network for Salient Object Detection24 Nov 2025
- 2025LEAF-Mamba: Local Emphatic and Adaptive Fusion State Space Model for RGB-D Salient Object Detection23 Sep 2025
- 2025Towards Size-invariant Salient Object Detection: A Generic Evaluation and Optimization Approach19 Sep 2025
- 2025WXSOD: A Benchmark for Robust Salient Object Detection in Adverse Weather Conditions17 Aug 2025
- 2025DMTrack: Spatio-Temporal Multimodal Tracking via Dual-Adapter3 Aug 2025
- 2025Unleashing the Power of Motion and Depth: A Selective Fusion Strategy for RGB-D Video Salient Object Detection29 Jul 2025
- 2025Lightweight RGB-D Salient Object Detection from a Speed-Accuracy Tradeoff Perspective7 May 2025
- 2025Dual Mutual Learning Network with Global-local Awareness for RGB-D Salient Object Detection3 Jan 2025
33 more
- 2024Deep Fourier-embedded Network for RGB and Thermal Salient Object Detection27 Nov 2024
- 2024MambaSOD: Dual Mamba-Driven Cross-Modal Fusion Network for RGB-D Salient Object Detection19 Oct 2024
- 2024Depth-guided Texture Diffusion for Image Semantic Segmentation17 Aug 2024
- 2024ViDSOD-100: A New Dataset and a Baseline Model for RGB-D Video Salient Object Detection18 Jun 2024
- 2024GeminiFusion: Efficient Pixel-wise Multimodal Fusion for Vision Transformer3 Jun 2024
- 2024Quality-aware Selective Fusion Network for V-D-T Salient Object Detection13 May 2024
- 2024MAS-SAM: Segment Any Marine Animal with Aggregated Features24 Apr 2024
- 2024Fantastic Animals and Where to Find Them: Segment Any Marine Animal with Dual SAM7 Apr 2024
- 2023Hybrid-Fusion Transformer for Multisequence MRI2 Nov 2023
- 2023Salient Object Detection in RGB-D Videos24 Oct 2023
- 2023Salient Object Detection in Optical Remote Sensing Images Driven by Transformer15 Sep 2023
- 2023Co-Salient Object Detection with Semantic-Level Consensus Extraction and Dispersion14 Sep 2023
- 2023Point-aware Interaction and CNN-induced Refinement Network for RGB-D Salient Object Detection17 Aug 2023
- 2023ComPtr: Towards Diverse Bi-source Dense Prediction Tasks via A Simple yet General Complementary Transformer23 Jul 2023
- 2023HODINet: High-Order Discrepant Interaction Network for RGB-D Salient Object Detection3 Jul 2023
- 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detection28 Jun 2023
- 2023Object Segmentation by Mining Cross-Modal Semantics17 May 2023
- 2023Towards Diverse Binary Segmentation via A Simple yet General Gated Network18 Mar 2023
- 2023HiDAnet: RGB-D Salient Object Detection via Hierarchical Depth Awareness18 Jan 2023
- 2023HRTransNet: HRFormer-Driven Two-Modality Salient Object Detection8 Jan 2023
- 2022Depth Quality-Inspired Feature Manipulation for Efficient RGB-D and Video Salient Object Detection8 Aug 2022
- 2022Robust RGB-D Fusion for Saliency Detection2 Aug 2022
- 2022Weakly Supervised Video Salient Object Detection via Point Supervision15 Jul 2022
- 2022SiaTrans: Siamese Transformer Network for RGB-D Salient Object Detection with Depth Image Classification9 Jul 2022
- 2022Mirror Complementary Transformer Network for RGB-thermal Salient Object Detection7 Jul 2022
- 2022TANet: Transformer-based Asymmetric Network for RGB-D Salient Object Detection4 Jul 2022
- 2022Dual Swin-Transformer based Mutual Interactive Network for RGB-D Salient Object Detection7 Jun 2022
- 2022GroupTransNet: Group Transformer Network for RGB-D Salient Object Detection21 Mar 2022
- 2022DFTR: Depth-supervised Fusion Transformer for Salient Object Detection12 Mar 2022
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformers9 Mar 2022
- 2021CAVER: Cross-Modal View-Mixed Transformer for Bi-Modal Salient Object Detection4 Dec 2021
- 2021MutualFormer: Multi-Modality Representation Learning via Cross-Diffusion Attention2 Dec 2021
- 2021MFEViT: A Robust Lightweight Transformer-based Network for Multimodal 2D+3D Facial Expression Recognition20 Sep 2021
- 2022CMX: Cross-Modal Fusion for RGB-X Semantic Segmentation with Transformerscited by 229
- 2023C2Former: Calibrated and Complementary Transformer for RGB-Infrared Object Detectioncited by 57
- 2021CAVER: Cross-Modal View-Mixed Transformer for Bi-Modal Salient Object Detectioncited by 47
- 2024GeminiFusion: Efficient Pixel-wise Multimodal Fusion for Vision Transformercited by 42
- 2023HiDAnet: RGB-D Salient Object Detection via Hierarchical Depth Awarenesscited by 31
- 2023HRTransNet: HRFormer-Driven Two-Modality Salient Object Detectioncited by 27
- 2023Point-aware Interaction and CNN-induced Refinement Network for RGB-D Salient Object Detectioncited by 25
- 2024Fantastic Animals and Where to Find Them: Segment Any Marine Animal with Dual SAMcited by 23
- 2023Towards Diverse Binary Segmentation via A Simple yet General Gated Networkcited by 17
- 2023Salient Object Detection in Optical Remote Sensing Images Driven by Transformercited by 17
- 2024MAS-SAM: Segment Any Marine Animal with Aggregated Featurescited by 15
- 2022Weakly Supervised Video Salient Object Detection via Point Supervisioncited by 13
12 most cited of 43 All 43 (JSON)
- 2026Learning Spatially Adaptive Structural Coordination for Underwater Salient Object Detection15 May 2026
- 2026OmniFood8K: Single-Image Nutrition Estimation via Hierarchical Frequency-Aligned Fusion14 Apr 2026
- 2026STENet: Superpixel Token Enhancing Network for RGB-D Salient Object Detection23 Mar 2026
- 2026HFP-SAM: Hierarchical Frequency Prompted SAM for Efficient Marine Animal Segmentation13 Mar 2026
- 2025DualGazeNet: A Biologically Inspired Dual-Gaze Query Network for Salient Object Detection24 Nov 2025
- 2025Towards Size-invariant Salient Object Detection: A Generic Evaluation and Optimization Approach19 Sep 2025
- 2025WXSOD: A Benchmark for Robust Salient Object Detection in Adverse Weather Conditions17 Aug 2025
- 2025DMTrack: Spatio-Temporal Multimodal Tracking via Dual-Adapter3 Aug 2025
- 2025Unleashing the Power of Motion and Depth: A Selective Fusion Strategy for RGB-D Video Salient Object Detection29 Jul 2025
- 2025Lightweight RGB-D Salient Object Detection from a Speed-Accuracy Tradeoff Perspective7 May 2025
- 2025Dual Mutual Learning Network with Global-local Awareness for RGB-D Salient Object Detection3 Jan 2025
- 2024Deep Fourier-embedded Network for RGB and Thermal Salient Object Detection27 Nov 2024
12 newest of 43 All 43 (JSON)