Few-Shot Vision-Language Reasoning for Satellite Imagery via Verifiable Rewards
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Recent advances in large language and vision-language models have enabled strong reasoning capabilities, yet they remain impractical for specialized domains like remote sensing, where annotated data is scarce and expensive. We present the first few-shot reinforcement learning with verifiable reward (RLVR) framework for satellite imagery that eliminates the need for caption supervision--relying solely on lightweight, rule-based binary or IoU-based rewards. Adapting the "1-shot RLVR" paradigm from language models to vision-language models, we employ policy-gradient optimization with as few as one curated example to align model outputs for satellite reasoning tasks. Comprehensive experiments across multiple remote sensing benchmarks--including classification, visual question answering, and grounding--show that even a single example yields substantial improvements over the base model. Scaling to 128 examples matches or exceeds models trained on thousands of annotated samples. While the extreme one-shot setting can induce mild, task-specific overfitting, our approach consistently demonstrates robust generalization and efficiency across diverse tasks. Further, we find that prompt design and loss weighting significantly influence training stability and final accuracy. Our method enables cost-effective and data-efficient development of domain-specialist vision-language reasoning models, offering a pragmatic recipe for data-scarce fields: start from a compact VLM, curate a handful of reward-checkable cases, and train via RLVR.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 24 of its 46 references that are in the map. First posted on arXiv 29 Jul 2025.
Builds on
24 of 46 references.
Closest ancestors · 1
Same direction, newest first
Other references · 23
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2023GPT-4 Technical Reportcited by 18,396
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2024GPT-4o System Cardcited by 4,588
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
- 2025Understanding R1-Zero-Like Training: A Critical Perspectivecited by 1,345
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,210
11 more
- 2025Does Reinforcement Learning Really Incentivize Reasoning Capacity in LLMs Beyond the Base Model?cited by 982
- 2024PaliGemma: A versatile 3B VLM for transfercited by 696
- 2025Cognitive Behaviors that Enable Self-Improving Reasoners, or, Four Habits of Highly Effective STaRscited by 377
- 2025Reinforcement Learning for Reasoning in Large Language Models with One Training Examplecited by 295
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 207
- 2024Fine-Tuned 'Small' LLMs (Still) Significantly Outperform Zero-Shot Generative AI Models in Text Classificationcited by 70
- 2025Rethinking Reflection in Pre-Trainingcited by 43
- 2024LHRS-Bot-Nova: Improved Multimodal Large Language Model for Remote Sensing Vision-Language Interpretationcited by 25
- 2025Quality-Driven Curation of Remote Sensing Vision-Language Data via Learned Scoring Modelscited by 11
- 2025TinyRS-R1: Compact Multimodal Language Model for Remote Sensingcited by 7
Built on by
Citing papers per year: 2025: 1; 2026: 2.
3 papers.
- 2025Asking like Socrates: Socrates helps VLMs understand remote sensing imagescited by 6
- 2026RS-WorldModel: a Unified Model for Remote Sensing Understanding and Future Sense Forecastingcited by 2
- 2026Boosting Reinforcement Learning with Verifiable Rewards via Randomly Selected Few-Shot Guidancecited by 0
- 2026Boosting Reinforcement Learning with Verifiable Rewards via Randomly Selected Few-Shot Guidance14 May 2026
- 2026RS-WorldModel: a Unified Model for Remote Sensing Understanding and Future Sense Forecasting16 Mar 2026
- 2025Asking like Socrates: Socrates helps VLMs understand remote sensing images27 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe
- 2025GeoVLM-R1: Reinforcement Fine-Tuning for Improved Remote Sensing Reasoning
- 2025Unlocking Zero-Shot Geospatial Reasoning via Indirect Rewards
- 2025GRASP: Geospatial pixel Reasoning viA Structured Policy learning
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models
- 2026GeoReason: Aligning Thinking And Answering In Remote Sensing Vision-Language Models Via Logical Consistency Reinforcement Learning
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes
- 2026RS-HyRe-R1: A Hybrid Reward Mechanism to Overcome Perceptual Inertia for Remote Sensing Images Understanding