More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Remote sensing vision-language models are increasingly expected to support open-ended reasoning over Earth Observation data and a variety of tasks. Most recent progress in this area has been driven by remote-sensing-specific architectural designs, often introducing new encoders, alignment modules, or task-specific fusion mechanisms. In this work, we challenge the necessity of such architectural specialization. We show that a generally capable vision-language model can achieve competitive or state-of-the-art performance at challenging remote sensing benchmarks, provided that it is trained at sufficient scale across diverse data and tasks. Our model uses a single language policy that can either answer directly in text or invoke a localization tool for segmentation and grounding. To train this heterogeneous behaviour, we employ a multi-task reinforcement learning framework with adaptive task rewards covering multiple-choice VQA, free-form VQA, captioning, detection, and segmentation across a large variety of input types. Our approach achieves competitive results across a broad set of benchmarks, including high-resolution, multi-temporal, multi-modal and multi-view tasks. Further, as training data scales, our experiments show consistent improvements across most tasks both in and out of distribution, which correlate with per-task data diversity. These findings suggest that, for remote sensing VLMs, data scale is sufficient even without architectural novelty.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 57 of its 62 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
57 of 62 references.
Closest ancestors · 30
Same direction, newest first
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks9 Jun
- 2026TerraScope: Pixel-Grounded Visual Reasoning for Earth Observation19 Mar
- 2026OSMDA: OpenStreetMap-based Domain Adaptation for Remote Sensing VLMs12 Mar
- 2026GeoEyes: On-Demand Visual Focusing for Evidence-Grounded Understanding of Ultra-High-Resolution Remote Sensing Imagery15 Feb
- 2026VLRS-Bench: A Vision-Language Reasoning Benchmark for Remote Sensing4 Feb
- 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs19 Dec
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes27 Nov
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models26 Sep
- 2025UrbanLLaVA: A Multi-modal Large Language Model for Urban Intelligence with Spatial Reasoning and Understanding29 Jun
- 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolution27 May
- 2025DisasterM3: A Remote Sensing Vision-Language Dataset for Disaster Damage Assessment and Response27 May
- 2025DynamicVL: Benchmarking Multimodal Large Language Models for Dynamic City Understanding27 May
18 more
- 2025LISAT: Language-Instructed Segmentation Assistant for Satellite Imagery5 May
- 2025EarthGPT-X: A Spatial MLLM for Multi-level Multi-Source Remote Sensing Imagery Understanding with Visual Prompting17 Apr
- 2025SARLANG-1M: A Benchmark for Vision-Language Modeling in SAR Image Understanding4 Apr
- 2025XLRS-Bench: Could Your Multimodal LLMs Understand Extremely Large Ultra-High-Resolution Remote Sensing Imagery?31 Mar
- 2025Falcon: A Remote Sensing Vision-Language Foundation Model (Technical Report)14 Mar
- 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruning10 Mar
- 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensing23 Jan
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
- 2024GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Tasks28 Nov
- 2024LHRS-Bot-Nova: Improved Multimodal Large Language Model for Remote Sensing Vision-Language Interpretation14 Nov
- 2024UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarios30 Aug
- 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensing18 Jul
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan
- 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model18 Jan
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
Other references · 27
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
- 2023Segment Anythingcited by 8,158
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
- 2024Qwen2.5 Technical Reportcited by 4,713
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
- 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,175
- 2021Per-Pixel Classification is Not All You Need for Semantic Segmentationcited by 1,148
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2025SFT Memorizes, RL Generalizes: A Comparative Study of Foundation Model Post-trainingcited by 655
15 more
- 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 69
- 2023RRSIS: Referring Remote Sensing Image Segmentationcited by 59
- 2025SegEarth-R1: Geospatial Pixel Reasoning via Large Language Modelcited by 40
- 2024Where am I? Cross-View Geo-localization with Natural Language Descriptionscited by 38
- 2025RemoteReasoner: Towards Unifying Geospatial Reasoning Workflowcited by 25
- 2025GeoVLM-R1: Reinforcement Fine-Tuning for Improved Remote Sensing Reasoningcited by 15
- 2025GeoVista: Web-Augmented Agentic Visual Reasoning for Geolocalizationcited by 10
- 2025UniGeoSeg: Towards Unified Open-World Segmentation for Geospatial Scenescited by 10
- 2025SegEarth-R2: Towards Comprehensive Language-guided Segmentation for Remote Sensing Imagescited by 10
- 2026EarthShift: a benchmark for measuring robustness to real-world distribution shifts in Earth observationcited by 8
- 2025SAM3-Adapter: Efficient Adaptation of Segment Anything 3 for Camouflage Object Segmentation, Shadow Detection, and Medical Image Segmentationcited by 7
- 2025Bridging Semantics and Geometry: A Decoupled LVLM-SAM Framework for Reasoning Segmentation in Optical Remote Sensingcited by 6
- 2025On the Effectiveness of Textual Prompting with Lightweight Fine-Tuning for SAM3 Remote Sensing Segmentationcited by 3
- 2026GeoSeg: Training-Free Reasoning-Driven Segmentation in Remote Sensing Imagerycited by 1
- 2026B-GRTO: Bootstrapped Group Relative Tool Optimization for Referring Segmentationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives
- 2025Few-Shot Vision-Language Reasoning for Satellite Imagery via Verifiable Rewards
- 2025Co-Training Vision Language Models for Remote Sensing Multi-task Learning
- 2024CHOICE: Benchmarking the Remote Sensing Capabilities of Large Vision-Language Models
- 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing
- 2025Quality-Driven Curation of Remote Sensing Vision-Language Data via Learned Scoring Models
- 2026SkyNative: A Native Multimodal Architecture for Remote Sensing Vision-Language Understanding
- 2025TinyRS-R1: Compact Multimodal Language Model for Remote Sensing