S2A:Semantic-to-Spatial Alignment for Alignment-Free RGB-T Salient Object Detection
Not on the map. Why?
Abstract (arXiv)
Alignment-free RGB-T salient object detection (RGB-T SOD) aims to identify salient objects from unregistered RGB and thermal image pairs without costly pre-alignment. However, spatial misalignment breaks pixel-wise correspondence and causes feature contamination during cross-modal fusion. To address this issue, we propose S2A, a semantic-to-spatial alignment framework for alignment-free RGB-T SOD. Specifically, a global-guided hierarchical fusion module (GGHF) first exploits global semantic guidance to suppress background interference and refine hierarchical intra-modal features. Subsequently, the alignment-free cross-modal channel attention module (AFCA) globally exchanges complementary semantic information through channel-wise interaction, effectively overcoming the interference caused by local spatial misalignments. Finally, a spatial deformable cross-attention module (SDCA) predicts adaptive sampling offsets to recover local cross-modal spatial correspondence. Through this semantic-to-spatial paradigm, S2A first enables reliable cross-modal semantic interaction and subsequently performs local spatial calibration, effectively reducing misalignment-induced feature contamination. Without bells and whistles, S2A achieves highly competitive performance on multiple public alignment-free RGB-T benchmarks, demonstrating its effectiveness in alleviating misalignment-induced feature contamination.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 40 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
24 of 40 references.
References · 24
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2018MobileNetV2: Inverted Residuals and Linear Bottleneckscited by 4,773
- 2017Decoupled Weight Decay Regularizationcited by 1,722
- 2017Structure-measure: A New Way to Evaluate Foreground Mapscited by 480
- 2019Res2Net: A New Multi-scale Backbone Architecturecited by 468
- 2018Enhanced-alignment Measure for Binary Foreground Map Evaluationcited by 370
- 2022SwinNet: Swin Transformer drives edge-aware RGB-D and RGB-T salient object detectioncited by 59
- 2021CAVER: Cross-Modal View-Mixed Transformer for Bi-Modal Salient Object Detectioncited by 47
- 2022Does Thermal Really Always Matter for RGB-T Salient Object Detection?cited by 37
- 2023HRTransNet: HRFormer-Driven Two-Modality Salient Object Detectioncited by 27
12 more
- 2024Alignment-Free RGBT Salient Object Detection: Semantics-guided Asymmetric Correlation Network and A Unified Benchmarkcited by 19
- 2024Learning Adaptive Fusion Bank for Multi-modal Salient Object Detectioncited by 19
- 2023Unified-modal Salient Object Detection via Adaptive Prompt Learningcited by 9
- 2024Alignment-Free RGB-T Salient Object Detection: A Large-scale Dataset and Progressive Correlation Networkcited by 9
- 2026TP-Seg: Task-Prototype Framework for Unified Medical Lesion Segmentationcited by 7
- 2026DifferSeg: Towards Diverse Multimodal Binary Segmentation via Differential Perception and Frequency Guidancecited by 6
- 2026HVPNet: A Bio-Inspired Network for General Salient and Camouflaged Object Detectioncited by 4
- 2026RA-SOD: Reliability-Aware RGB-T Salient Object Detection under Modality Degradationcited by 2
- 2024Efficient Fourier Filtering Network with Contrastive Learning for AAV-based Unaligned Bimodal Salient Object Detectioncited by 1
- 2025Breaking Alignment Barriers: TPS-Driven Semantic Correlation Learning for Alignment-Free RGB-T Salient Object Detectioncited by 1
- 2026TDFNet: Tri-projection Deformable Fusion Network for Panoramic Salient Object Detectioncited by 1
- 2026ViCo-SAM3: Vision-Conditioned Alignment for Open-Vocabulary Camouflaged Object Segmentationcited by 1
Built on by
Not cited yet.