mlsanityData to 14 Oct 2026

Prompt-Calibrated SAM 3 for Open-Vocabulary Remote Sensing Semantic Segmentation

arXiv 2606.21863 ↗First posted 20 Jun 2026cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Open-vocabulary semantic segmentation (OVSS) in remote sensing images aims to segment categories beyond a fixed label space. Recent SAM 3-based methods provide a promising training-free foundation, yet three key issues remain: (1) a single class-name prompt lacks sufficient semantic coverage for complex remote sensing categories; (2) expanding each category into multiple prompts introduces redundant online text encoding; and (3) directly aggregating multiple prompt responses propagates noisy activations into the final prediction. To address these issues, we propose ProC-SAM3, which calibrates SAM 3's prompt interface for remote sensing OVSS from three complementary aspects. First, we construct an offline prompt pool where a Category Matcher groups MLLM-generated candidates into per-category sets, and Expansion Constraints further refine each set using category-specific prior knowledge. Second, the resulting text embeddings are cached and reused across all test images, eliminating repeated text encoding. Third, we introduce Presence-Guided Residual Fusion to gate unreliable decoder outputs by prompt presence and confidence, followed by peak-preserving class aggregation that retains fine-grained activations for small and sparse objects. Experiments on eight benchmarks show that ProC-SAM3 achieves an average mIoU of 56.1%, outperforming the previous best training-free method by 3.9 percentage points. Code will be available at https://github.com/YanghuiSong/ProC-SAM3.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 13 of its 17 references that are in the map. First posted on arXiv 20 Jun 2026.

Builds on

13 of 17 references.

References · 13

  1. 2025SAM 3: Segment Anything with Conceptscited by 906
  2. 2023SCLIP: Rethinking Self-Attention for Dense Vision-Language Inferencecited by 170
  3. 2024ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inferencecited by 113
  4. 2024ProxyCLIP: Proxy Attention Improves CLIP for Open-Vocabulary Segmentationcited by 111
  5. 2024CorrCLIP: Reconstructing Patch Correlations in CLIP for Open-Vocabulary Semantic Segmentationcited by 34
  6. 2024SegEarth-OV: Towards Training-Free Open-Vocabulary Segmentation for Remote Sensing Imagescited by 25
  7. 2024PointSAM: Pointly-Supervised Segment Anything Model for Remote Sensing Imagescited by 24
  8. 2025SegEarth-OV3: Exploring SAM 3 for Open-Vocabulary Semantic Segmentation in Remote Sensing Imagescited by 16
  9. 2025Annotation-Free Open-Vocabulary Segmentation for Remote-Sensing Imagescited by 8
  10. 2025SOTA: Self-adaptive Optimal Transport for Zero-Shot Classification with Multiple Foundation Modelscited by 6
  11. 2026Taming SAM3 in the Wild: A Concept Bank for Open-Vocabulary Segmentationcited by 4
  12. 2026ConInfer: Context-Aware Inference for Training-Free Open-Vocabulary Remote Sensing Segmentationcited by 3
1 more
  1. 2026VIP: Visual-guided Prompt Evolution for Efficient Dense Vision-Language Inferencecited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024Towards Open-Vocabulary Remote Sensing Image Semantic Segmentation
  2. 2024Open-Vocabulary Remote Sensing Image Semantic Segmentation
  3. 2026Enabling Training-Free Text-Based Remote Sensing Segmentation
  4. 2026SatOV: Restoring Spatial Priors for Training-Free Open-Vocabulary Segmentation in Remote Sensing Imagery
  5. 2026Open-Vocabulary Semantic Segmentation in Remote Sensing via Hierarchical Attention Masking and Model Composition
  6. 2026Geospatial-Reasoning-Driven Vocabulary-Agnostic Remote Sensing Semantic Segmentation
  7. 2026bi-modal textual prompt learning for vision-language models in remote sensing
  8. 2025Toward Stable Semi-Supervised Remote Sensing Segmentation via Co-Guidance and Co-Fusion