mlsanityData to 14 Oct 2026

Geo-R1: Improving Few-Shot Geospatial Referring Expression Understanding with Reinforcement Fine-Tuning

arXiv 2509.21976 ↗First posted 26 Sep 2025cs.CV cs.AIcited by 20

Not on the map. Why?

Abstract (arXiv)

Referring expression understanding in remote sensing poses unique challenges, as it requires reasoning over complex object-context relationships. While supervised fine-tuning (SFT) on multimodal large language models achieves strong performance with massive labeled datasets, they struggle in data-scarce scenarios, leading to poor generalization. To address this limitation, we propose Geo-R1, a reasoning-centric reinforcement fine-tuning (RFT) paradigm for few-shot geospatial referring. Geo-R1 enforces the model to first generate explicit, interpretable reasoning chains that decompose referring expressions, and then leverage these rationales to localize target objects. This "reason first, then act" process enables the model to make more effective use of limited annotations, enhances generalization, and provides interpretability. We validate Geo-R1 on three carefully designed few-shot geospatial referring benchmarks, where our model consistently and substantially outperforms SFT baselines. It also demonstrates strong cross-dataset generalization, highlighting its robustness. Code and data will be released at: https://github.com/Geo-R1/geo-r1.

Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 51 of its 73 references that are in the map. First posted on arXiv 26 Sep 2025.

Builds on

51 of 73 references.

References · 51

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  4. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  5. 2025Qwen2.5-VL Technical Reportcited by 5,587
  6. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  8. 2017Prototypical Networks for Few-shot Learningcited by 3,015
  9. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  10. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  11. 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
  12. 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
38 more
  1. 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
  2. 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
  3. 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
  4. 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
  5. 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
  6. 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
  7. 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
  8. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
  9. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
  10. 2020Frustratingly Simple Few-Shot Object Detectioncited by 282
  11. 2023GRES: Generalized Referring Expression Segmentationcited by 254
  12. 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 248
  13. 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
  14. 2018Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learningcited by 211
  15. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
  16. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
  17. 2023Towards Open Vocabulary Learning: A Surveycited by 166
  18. 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 165
  19. 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 123
  20. 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 121
  21. 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 104
  22. 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trendscited by 93
  23. 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysiscited by 86
  24. 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 85
  25. 2020DPGN: Distribution Propagation Graph Network for Few-shot Learningcited by 79
  26. 2023Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentationcited by 76
  27. 2023RRSIS: Referring Remote Sensing Image Segmentationcited by 59
  28. 2024Locate Anything on Earth: Advancing Open-Vocabulary Object Detection for Remote Sensing Communitycited by 50
  29. 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Groundingcited by 47
  30. 2023GREC: Generalized Referring Expression Comprehensioncited by 42
  31. 2025SegEarth-R1: Geospatial Pixel Reasoning via Large Language Modelcited by 42
  32. 2025RemoteSAM: Towards Segment Anything for Earth Observationcited by 39
  33. 2024Towards Vision-Language Geo-Foundation Model: A Surveycited by 36
  34. 2020Few-shot Object Detection on Remote Sensing Imagescited by 23
  35. 2023Toward Open Vocabulary Aerial Object Detection with CLIP-Activated Student-Teacher Learningcited by 22
  36. 2024CHOICE: Benchmarking the Remote Sensing Capabilities of Large Vision-Language Modelscited by 22
  37. 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
  38. 2025SARChat-Bench-2M: A Multi-Task Vision-Language Benchmark for SAR Image Interpretationcited by 5

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 3; 2026: 17.

20 papers.

Sort:

By area:

  1. 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenescited by 14
  2. 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Imagescited by 10
  3. 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoningcited by 8
  4. 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMscited by 8
  5. 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristicscited by 5
  6. 2025ViLaCD-R1: A Vision-Language Framework for Semantic Change Detection in Remote Sensingcited by 3
  7. 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervisioncited by 2
  8. 2026RemoteShield: Enable Robust Multimodal Large Language Models for Earth Observationcited by 2
  9. 2026WeaveEarth: Structured Evidence Construction and Reasoning for Training-Free UHR Remote Sensing Understandingcited by 2
  10. 2026A Training-Free Guess What Vision Language Model from Snippets to Open-Vocabulary Object Detectioncited by 1
  11. 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagerycited by 1
  12. 2026UAV traffic scene understanding: A regulation embedded multi-modal network and a unified benchmarkcited by 1
8 more
  1. 2026GeoSearcher: Anchor-Guided Progressive Reasoning for Remote Sensing Visual Grounding with Process Supervisioncited by 1
  2. 2026HoloGeo: Mitigating Landmark Bias in Geo-localization via Evidence-Driven Reasoningcited by 1
  3. 2026RS-HyRe-R1: A Hybrid Reward Mechanism to Overcome Perceptual Inertia for Remote Sensing Images Understandingcited by 0
  4. 2026Earth Science Foundation Models: From Perception to Reasoning and Discoverycited by 0
  5. 2026FUSAR-R1: A Large-Scale Reasoning Model for Intelligent Interpretation of SAR Imagescited by 0
  6. 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?cited by 0
  7. 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoningcited by 0
  8. 2026Knowing Whether, Not Just Where: Anchor-Probing Distillation for Open-Set Remote Sensing Visual Groundingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models
  2. 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing
  3. 2025ColLab: A Collaborative Spatial Progressive Data Engine for Referring Expression Comprehension and Generation
  4. 2025RemoteReasoner: Towards Unifying Geospatial Reasoning Workflow
  5. 2025GRASP: Geospatial pixel Reasoning viA Structured Policy learning
  6. 2026Towards Open-World Referring Expression Comprehension: A Benchmark with Training-free Multi-task Consistency Checker
  7. 2026GeoReason: Aligning Thinking And Answering In Remote Sensing Vision-Language Models Via Logical Consistency Reinforcement Learning
  8. 2026Vision-Language Reasoning for Geolocalization: A Reinforcement Learning Approach