Decouple and Rectify: Semantics-Preserving Structural Enhancement for Open-Vocabulary Remote Sensing Segmentation
Not on the map. Why?
Abstract (arXiv)
Open-vocabulary semantic segmentation in the remote sensing (RS) field requires both language-aligned recognition and fine-grained spatial delineation. Although CLIP offers robust semantic generalization, its global-aligned visual representations inherently struggle to capture structural details. Recent methods attempt to compensate for this by introducing RS-pretrained DINO features. However, these methods treat CLIP representations as a monolithic semantic space and cannot localize where structural enhancement is required, failing to effectively delineate boundaries while risking the disruption of CLIP's semantic integrity. To address this limitation, we propose DR-Seg, a novel decouple-and-rectify framework in this paper. Our method is motivated by the key observation that CLIP feature channels exhibit distinct functional heterogeneity rather than forming a uniform semantic space. Building on this insight, DR-Seg decouples CLIP features into semantics-dominated and structure-dominated subspaces, enabling targeted structural enhancement by DINO without distorting language-aligned semantics. Subsequently, a prior-driven graph rectification module injects high-fidelity structural priors under DINO guidance to form a refined branch, while an uncertainty-guided adaptive fusion module dynamically integrates this refined branch with the original CLIP branch for final prediction. Comprehensive experiments across eight benchmarks demonstrate that DR-Seg establishes a new state-of-the-art.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 21 of its 33 references that are in the map. First posted on arXiv 2 Apr 2026.
Builds on
21 of 33 references.
References · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023Segment Anythingcited by 8,158
- 2021Extract Free Dense Labels from CLIPcited by 580
- 2022Open-Vocabulary Semantic Segmentation with Mask-adapted CLIPcited by 560
- 2021Scaling Open-Vocabulary Image Segmentation with Image-Level Labelscited by 471
- 2023Side Adapter Network for Open-Vocabulary Semantic Segmentationcited by 296
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 259
- 2023CAT-Seg: Cost Aggregation for Open-Vocabulary Semantic Segmentationcited by 215
- 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 169
- 2024ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inferencecited by 112
- 2024ProxyCLIP: Proxy Attention Improves CLIP for Open-Vocabulary Segmentationcited by 110
- 2023SED: A Simple Encoder-Decoder for Open-Vocabulary Semantic Segmentationcited by 95
9 more
- 2024Pay Attention to Your Neighbours: Training-Free Open-Vocabulary Semantic Segmentationcited by 76
- 2023Open-Vocabulary Segmentation with Semantic-Assisted Calibrationcited by 49
- 2023VDD: Varied Drone Dataset for Semantic Segmentationcited by 39
- 2024Self-Calibrated CLIP for Training-Free Open-Vocabulary Segmentationcited by 34
- 2024CorrCLIP: Reconstructing Patch Correlations in CLIP for Open-Vocabulary Semantic Segmentationcited by 33
- 2024ResCLIP: Residual Attention for Training-free Dense Vision-language Inferencecited by 28
- 2024Effective SAM Combination for Open-Vocabulary Semantic Segmentationcited by 15
- 2024ZoRI: Towards Discriminative Zero-Shot Remote Sensing Instance Segmentationcited by 7
- 2025SCORE: Scene Context Matters in Open-Vocabulary Remote Sensing Instance Segmentationcited by 7
Built on by
Not cited yet.