Geo-R1: Improving Few-Shot Geospatial Referring Expression Understanding with Reinforcement Fine-Tuning
Not on the map. Why?
Abstract (arXiv)
Referring expression understanding in remote sensing poses unique challenges, as it requires reasoning over complex object-context relationships. While supervised fine-tuning (SFT) on multimodal large language models achieves strong performance with massive labeled datasets, they struggle in data-scarce scenarios, leading to poor generalization. To address this limitation, we propose Geo-R1, a reasoning-centric reinforcement fine-tuning (RFT) paradigm for few-shot geospatial referring. Geo-R1 enforces the model to first generate explicit, interpretable reasoning chains that decompose referring expressions, and then leverage these rationales to localize target objects. This "reason first, then act" process enables the model to make more effective use of limited annotations, enhances generalization, and provides interpretability. We validate Geo-R1 on three carefully designed few-shot geospatial referring benchmarks, where our model consistently and substantially outperforms SFT baselines. It also demonstrates strong cross-dataset generalization, highlighting its robustness. Code and data will be released at: https://github.com/Geo-R1/geo-r1.
Key facts. Cited by 20 papers in the map (data through 14 Oct 2026). Builds on 51 of its 73 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
51 of 73 references.
References · 51
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2017Prototypical Networks for Few-shot Learningcited by 3,015
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
- 2024LlamaFactory: Unified Efficient Fine-Tuning of 100+ Language Modelscited by 1,464
- 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
38 more
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2025Vision-R1: Incentivizing Reasoning Capability in Multimodal Large Language Modelscited by 665
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
- 2025VLM-R1: A Stable and Generalizable R1-style Large Vision-Language Modelcited by 526
- 2025Visual-RFT: Visual Reinforcement Fine-Tuningcited by 513
- 2025R1-Onevision: Advancing Generalized Multimodal Reasoning through Cross-Modal Formalizationcited by 370
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
- 2020Frustratingly Simple Few-Shot Object Detectioncited by 282
- 2023GRES: Generalized Referring Expression Segmentationcited by 254
- 2025LMM-R1: Empowering 3B LMMs with Strong Reasoning Abilities Through Two-Stage Rule-Based RLcited by 248
- 2025Seg-Zero: Reasoning-Chain Guided Segmentation via Cognitive Reinforcementcited by 239
- 2018Learning to Propagate Labels: Transductive Propagation Network for Few-shot Learningcited by 211
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
- 2023Towards Open Vocabulary Learning: A Surveycited by 166
- 2025R1-Zero's "Aha Moment" in Visual Reasoning on a 2B Non-SFT Modelcited by 165
- 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 123
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 121
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 104
- 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trendscited by 93
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysiscited by 86
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 85
- 2020DPGN: Distribution Propagation Graph Network for Few-shot Learningcited by 79
- 2023Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentationcited by 76
- 2023RRSIS: Referring Remote Sensing Image Segmentationcited by 59
- 2024Locate Anything on Earth: Advancing Open-Vocabulary Object Detection for Remote Sensing Communitycited by 50
- 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Groundingcited by 47
- 2023GREC: Generalized Referring Expression Comprehensioncited by 42
- 2025SegEarth-R1: Geospatial Pixel Reasoning via Large Language Modelcited by 42
- 2025RemoteSAM: Towards Segment Anything for Earth Observationcited by 39
- 2024Towards Vision-Language Geo-Foundation Model: A Surveycited by 36
- 2020Few-shot Object Detection on Remote Sensing Imagescited by 23
- 2023Toward Open Vocabulary Aerial Object Detection with CLIP-Activated Student-Teacher Learningcited by 22
- 2024CHOICE: Benchmarking the Remote Sensing Capabilities of Large Vision-Language Modelscited by 22
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectivescited by 18
- 2025SARChat-Bench-2M: A Multi-Task Vision-Language Benchmark for SAR Image Interpretationcited by 5
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2025: 3; 2026: 17.
20 papers.
Sort:
By area:
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenescited by 14
- 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Imagescited by 10
- 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoningcited by 8
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMscited by 8
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristicscited by 5
- 2025ViLaCD-R1: A Vision-Language Framework for Semantic Change Detection in Remote Sensingcited by 3
- 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervisioncited by 2
- 2026RemoteShield: Enable Robust Multimodal Large Language Models for Earth Observationcited by 2
- 2026WeaveEarth: Structured Evidence Construction and Reasoning for Training-Free UHR Remote Sensing Understandingcited by 2
- 2026A Training-Free Guess What Vision Language Model from Snippets to Open-Vocabulary Object Detectioncited by 1
- 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagerycited by 1
- 2026UAV traffic scene understanding: A regulation embedded multi-modal network and a unified benchmarkcited by 1
8 more
- 2026GeoSearcher: Anchor-Guided Progressive Reasoning for Remote Sensing Visual Grounding with Process Supervisioncited by 1
- 2026HoloGeo: Mitigating Landmark Bias in Geo-localization via Evidence-Driven Reasoningcited by 1
- 2026RS-HyRe-R1: A Hybrid Reward Mechanism to Overcome Perceptual Inertia for Remote Sensing Images Understandingcited by 0
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discoverycited by 0
- 2026FUSAR-R1: A Large-Scale Reasoning Model for Intelligent Interpretation of SAR Imagescited by 0
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?cited by 0
- 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoningcited by 0
- 2026Knowing Whether, Not Just Where: Anchor-Probing Distillation for Open-Set Remote Sensing Visual Groundingcited by 0
- 2026Knowing Whether, Not Just Where: Anchor-Probing Distillation for Open-Set Remote Sensing Visual Grounding9 Oct 2026
- 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning25 Aug 2026
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?22 Jul 2026
- 2026FUSAR-R1: A Large-Scale Reasoning Model for Intelligent Interpretation of SAR Images18 Jul 2026
- 2026HoloGeo: Mitigating Landmark Bias in Geo-localization via Evidence-Driven Reasoning16 Jul 2026
- 2026WeaveEarth: Structured Evidence Construction and Reasoning for Training-Free UHR Remote Sensing Understanding11 Jul 2026
- 2026GeoSearcher: Anchor-Guided Progressive Reasoning for Remote Sensing Visual Grounding with Process Supervision1 Jul 2026
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discovery9 May 2026
- 2026RS-HyRe-R1: A Hybrid Reward Mechanism to Overcome Perceptual Inertia for Remote Sensing Images Understanding19 Apr 2026
- 2026RemoteShield: Enable Robust Multimodal Large Language Models for Earth Observation19 Apr 2026
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMs9 Apr 2026
- 2026UAV traffic scene understanding: A regulation embedded multi-modal network and a unified benchmark11 Mar 2026
8 more
- 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervision10 Mar 2026
- 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagery22 Feb 2026
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristics13 Feb 2026
- 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoning29 Jan 2026
- 2026A Training-Free Guess What Vision Language Model from Snippets to Open-Vocabulary Object Detection17 Jan 2026
- 2025ViLaCD-R1: A Vision-Language Framework for Semantic Change Detection in Remote Sensing29 Dec 2025
- 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Images23 Dec 2025
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes27 Nov 2025
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenescited by 14
- 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoningcited by 8
- 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervisioncited by 2
- 2026WeaveEarth: Structured Evidence Construction and Reasoning for Training-Free UHR Remote Sensing Understandingcited by 2
- 2026GeoSearcher: Anchor-Guided Progressive Reasoning for Remote Sensing Visual Grounding with Process Supervisioncited by 1
- 2026HoloGeo: Mitigating Landmark Bias in Geo-localization via Evidence-Driven Reasoningcited by 1
- 2026HoloGeo: Mitigating Landmark Bias in Geo-localization via Evidence-Driven Reasoning16 Jul 2026
- 2026WeaveEarth: Structured Evidence Construction and Reasoning for Training-Free UHR Remote Sensing Understanding11 Jul 2026
- 2026GeoSearcher: Anchor-Guided Progressive Reasoning for Remote Sensing Visual Grounding with Process Supervision1 Jul 2026
- 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervision10 Mar 2026
- 2026RSGround-R1: Rethinking Remote Sensing Visual Grounding through Spatial Reasoning29 Jan 2026
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes27 Nov 2025
- 2026RemoteShield: Enable Robust Multimodal Large Language Models for Earth Observationcited by 2
- 2026A Training-Free Guess What Vision Language Model from Snippets to Open-Vocabulary Object Detectioncited by 1
- 2026RS-HyRe-R1: A Hybrid Reward Mechanism to Overcome Perceptual Inertia for Remote Sensing Images Understandingcited by 0
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?cited by 0
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?22 Jul 2026
- 2026RS-HyRe-R1: A Hybrid Reward Mechanism to Overcome Perceptual Inertia for Remote Sensing Images Understanding19 Apr 2026
- 2026RemoteShield: Enable Robust Multimodal Large Language Models for Earth Observation19 Apr 2026
- 2026A Training-Free Guess What Vision Language Model from Snippets to Open-Vocabulary Object Detection17 Jan 2026
- 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Imagescited by 10
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristicscited by 5
- 2025ViLaCD-R1: A Vision-Language Framework for Semantic Change Detection in Remote Sensingcited by 3
- 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagerycited by 1
- 2026UAV traffic scene understanding: A regulation embedded multi-modal network and a unified benchmarkcited by 1
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discoverycited by 0
- 2026FUSAR-R1: A Large-Scale Reasoning Model for Intelligent Interpretation of SAR Imagescited by 0
- 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoningcited by 0
- 2026Knowing Whether, Not Just Where: Anchor-Probing Distillation for Open-Set Remote Sensing Visual Groundingcited by 0
- 2026Knowing Whether, Not Just Where: Anchor-Probing Distillation for Open-Set Remote Sensing Visual Grounding9 Oct 2026
- 2026GeoRefer-Bench: A Benchmark from Referring Pixels to Verifiable Geospatial Reasoning25 Aug 2026
- 2026FUSAR-R1: A Large-Scale Reasoning Model for Intelligent Interpretation of SAR Images18 Jul 2026
- 2026Earth Science Foundation Models: From Perception to Reasoning and Discovery9 May 2026
- 2026UAV traffic scene understanding: A regulation embedded multi-modal network and a unified benchmark11 Mar 2026
- 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagery22 Feb 2026
- 2026GeoAgent: Learning to Geolocate Everywhere with Reinforced Geographic Characteristics13 Feb 2026
- 2025ViLaCD-R1: A Vision-Language Framework for Semantic Change Detection in Remote Sensing29 Dec 2025
- 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Images23 Dec 2025
Similar, not cited
Close in wording, no citation either way
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models
- 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing
- 2025ColLab: A Collaborative Spatial Progressive Data Engine for Referring Expression Comprehension and Generation
- 2025RemoteReasoner: Towards Unifying Geospatial Reasoning Workflow
- 2025GRASP: Geospatial pixel Reasoning viA Structured Policy learning
- 2026Towards Open-World Referring Expression Comprehension: A Benchmark with Training-free Multi-task Consistency Checker
- 2026GeoReason: Aligning Thinking And Answering In Remote Sensing Vision-Language Models Via Logical Consistency Reinforcement Learning
- 2026Vision-Language Reasoning for Geolocalization: A Reinforcement Learning Approach