Spatial-Regularization-Aware Dual-Branch Collaborative Inference for Training-Free OVSS in Remote Sensing Imagery
Not on the map. Why?
Abstract (arXiv)
High-resolution remote sensing images contain densely distributed objects with pronounced scale variations and complex boundaries, which impose higher demands on both the geometric localization and semantic prediction capabilities of semantic segmentation models. Existing training-free open-vocabulary semantic segmentation (OVSS) methods typically fuse Contrastive Language-Image Pretraining (CLIP) and vision foundation models (VFMs) using one-way injection and shallow post-processing strategies, making it difficult to satisfy these requirements. To address this issue, we propose a spatial-regularization-aware dual-branch collaborative inference framework for training-free OVSS, termed SDCI. First, during feature encoding, SDCI introduces a cross-model attention fusion (CAF) module, which guides collaborative inference by injecting self-attention maps into each other. Second, we propose a bidirectional cross-graph diffusion refinement (BCDR) module that enhances the reliability of dual-branch segmentation scores through iterative random-walk diffusion. Finally, we incorporate low-level superpixel structures and develop a convex-optimization-based superpixel collaborative prediction (CSCP) mechanism to further refine object boundaries. Experiments on multiple remote sensing semantic segmentation benchmarks demonstrate that our method achieves better performance than existing approaches. Our code is available at https://github.com/yu-ni1989/SDCI.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 49 references that are in the map. First posted on arXiv 29 Jan 2026.
Builds on
29 of 49 references.
References · 29
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
- 2021DenseCLIP: Language-Guided Dense Prediction with Context-Aware Promptingcited by 532
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 261
- 2023Personalize Segment Anything Model with One Shotcited by 250
- 2021Localizing Objects with Self-Supervised Transformers and no Labelscited by 230
- 2019iSAID: A Large-scale Dataset for Instance Segmentation in Aerial Imagescited by 197
- 2023Cut and Learn for Unsupervised Object Detection and Instance Segmentationcited by 187
- 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 170
17 more
- 2018Land-Cover Classification with High-Resolution Remote Sensing Images Using Transferable Deep Modelscited by 119
- 2022ReCo: Retrieve and Co-segment for Zero-shot Transfercited by 117
- 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 116
- 2024ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inferencecited by 113
- 2024Pay Attention to Your Neighbours: Training-Free Open-Vocabulary Semantic Segmentationcited by 77
- 2023CLIP as RNN: Segment Countless Visual Concepts without Training Endeavorcited by 69
- 2024Explore the Potential of CLIP for Training-Free Open Vocabulary Semantic Segmentationcited by 61
- 2024Harnessing Vision Foundation Models for High-Performance, Training-Free Open Vocabulary Segmentationcited by 39
- 2024In Defense of Lazy Visual Grounding for Open-Vocabulary Semantic Segmentationcited by 38
- 2023VideoCutLER: Surprisingly Simple Unsupervised Video Instance Segmentationcited by 37
- 2024CorrCLIP: Reconstructing Patch Correlations in CLIP for Open-Vocabulary Semantic Segmentationcited by 34
- 2024ResCLIP: Residual Attention for Training-free Dense Vision-language Inferencecited by 29
- 2025OmniSAM: Omnidirectional Segment Anything Model for UDA in Panoramic Semantic Segmentationcited by 28
- 2024Distilling Spectral Graph for Object-Context Aware Open-Vocabulary Semantic Segmentationcited by 24
- 2024CLIPer: Hierarchically Improving Spatial Representation of CLIP for Open-Vocabulary Semantic Segmentationcited by 17
- 2025CLIP Under the Microscope: A Fine-Grained Analysis of Multi-Object Representationcited by 14
- 2025E-SAM: Training-Free Segment Every Entity Modelcited by 3
Built on by
Not cited yet.