DiffuSAM: Diffusion Guided Zero-Shot Object Grounding for Remote Sensing Imagery
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Diffusion models have emerged as powerful tools for a wide range of vision tasks, including text-guided image generation and editing. In this work, we explore their potential for object grounding in remote sensing imagery. We propose a hybrid pipeline that integrates diffusion-based localization cues with state-of-the-art segmentation models such as RemoteSAM and SAM3 to obtain more accurate bounding boxes. By leveraging the complementary strengths of generative diffusion models and foundational segmentation models, our approach enables robust and adaptive object localization across complex scenes. Experiments demonstrate that our pipeline significantly improves localization performance, achieving over a 14% increase in [email protected] compared to existing state-of-the-art methods.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 8 of its 10 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
8 of 10 references.
References · 8
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 116
- 2016A Survey on Object Detection in Optical Remote Sensing Imagescited by 78
- 2025RemoteSAM: Towards Segment Anything for Earth Observationcited by 38
- 2025Qwen-Image-Layered: Towards Inherent Editability via Layer Decompositioncited by 29
- 2025Falcon: A Remote Sensing Vision-Language Foundation Model (Technical Report)cited by 28
- 2025EarthMind: Leveraging Cross-Sensor Data for Advanced Earth Observation Interpretation with a Unified Multimodal LLMcited by 18
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Object Fidelity Diffusion for Remote Sensing Image Generation
- 2024Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives
- 2025Tackling Few-Shot Segmentation in Remote Sensing via Inpainting Diffusion Model
- 2026Training-Free Open-Vocabulary Visual Grounding for Remote Sensing Images and Videos
- 2026A Unified Framework and Dataset for Oriented Object Visual Grounding in Remote Sensing
- 2023VGDiffZero: Text-to-image Diffusion Models Can Be Zero-shot Visual Grounders
- 2025Control Copy-Paste: Controllable Diffusion-Based Augmentation Method for Remote Sensing Few-Shot Object Detection
- 2025A Gift from the Integration of Discriminative and Diffusion-based Generative Learning: Boundary Refinement Remote Sensing Semantic Segmentation