Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
RS-MLLMs enable natural-language understanding and spatial reasoning over earth observation imagery. However, existing models support only a narrow range of sensor types and tasks, yielding a fragmented view of the earth and leaving cross-modal geoscientific knowledge largely unexploited. This work presents Earth-OneVision, a 2B RS-MLLM that unifies six sensor modalities (i.e., optical, SAR, infrared, multispectral, temporal, and video) and cross-sensor fusion across 9 task categories within a single autoregressive framework. Three dedicated mechanisms address three bottlenecks. Full-Granularity Vision-Language Alignment (FGVLA) aligns multi-level visual features with the multi-dimensional language space. Spatial-Linguistic Isomorphic Serialization (SLIS) unifies heterogeneous spatial outputs as autoregressive tokens. Progressive Cross-Modality Adaptation (PCMA) decomposes the compound domain gap into sequential stages, tackling the viewpoint and imaging physics gaps in turn. To support joint training, MMRS-OneVision is constructed with ~34M QA pairs spanning all six sensor modalities and cross-sensor fusion across 9 task categories, substantially exceeding existing RS multimodal instruction datasets. With only 2B parameters, Earth-OneVision achieves competitive or state-of-the-art results across extensive benchmarks, consistently matching or outperforming 4B-72B RS-MLLMs. It achieves 87.52% [email protected] on the OPT-RSVG testset for optical visual grounding and 80.68% on the SAR VQA benchmark SARLANG-Bench, exceeding 7B models by over 7%. It further achieves 75.74% recall on the BigEarthNet-MS testset for multispectral classification, and 81.94% MCQ accuracy on EarthMind-Bench for cross-modality reasoning.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 94 of its 131 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
94 of 131 references.
Closest ancestors · 3
Same direction, newest first
- 2025Towards Faithful Reasoning in Remote Sensing: A Perceptually-Grounded GeoSpatial Chain-of-Thought for Vision-Language Models26 Sep
- 2025EarthGPT-X: A Spatial MLLM for Multi-level Multi-Source Remote Sensing Imagery Understanding with Visual Prompting17 Apr
- 2025SegEarth-R1: Geospatial Pixel Reasoning via Large Language Model13 Apr
Other references · 91
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2025Qwen3 Technical Reportcited by 8,820
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2025Qwen2.5-VL Technical Reportcited by 5,587
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2023Qwen Technical Reportcited by 3,344
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,834
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
38 more
- 2023Shikra: Unleashing Multimodal LLM's Referential Dialogue Magiccited by 906
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
- 2023LISA: Reasoning Segmentation via Large Language Modelcited by 776
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
- 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 509
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 340
- 2017Functional Map of the Worldcited by 338
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
- 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 292
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 261
- 2021Oriented R-CNN for Object Detectioncited by 231
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmarkcited by 207
- 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 203
- 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 197
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
- 2020FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understandingcited by 181
- 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
- 2022A Unified Sequence Interface for Vision Taskscited by 152
- 2023PolyFormer: Referring Image Segmentation as Sequential Polygon Generationcited by 148
- 2018xView: Objects in Context in Overhead Imagerycited by 146
- 2021FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagerycited by 143
- 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 125
- 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 123
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understandingcited by 121
- 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Modelcited by 113
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understandingcited by 104
- 2017PatternNet: A Benchmark Dataset for Performance Evaluation of Remote Sensing Image Retrievalcited by 97
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysiscited by 86
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialoguescited by 85
- 2022OpenEarthMap: A Benchmark Dataset for Global High-Resolution Land Cover Mappingcited by 82
- 2021S2Looking: A Satellite Side-Looking Dataset for Building Change Detectioncited by 77
- 2023Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentationcited by 76
- 2024DeepStack: Deeply Stacking Visual Tokens is Surprisingly Simple and Effective for LMMscited by 75
- 2025Detect Anything via Next Point Predictioncited by 73
- 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 70
- 2024Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysiscited by 63
- 2020Deep Learning Meets SARcited by 60
50 most cited of 91 All 91 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipecited by 0
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?cited by 0
- 2026Lightweight Adaptation of General-Purpose VLMs for Multispectral and SAR Image Understandingcited by 0
- 2026MajorTOM:Elliot Pretrain, A Multi-Sensor, Multi-Temporal Pretraining Dataset for Earth Observationcited by 0
- 2026MajorTOM:Elliot Pretrain, A Multi-Sensor, Multi-Temporal Pretraining Dataset for Earth Observation13 Oct 2026
- 2026Lightweight Adaptation of General-Purpose VLMs for Multispectral and SAR Image Understanding2 Sep 2026
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?22 Jul 2026
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe17 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks
- 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing
- 2026SkyNative: A Native Multimodal Architecture for Remote Sensing Vision-Language Understanding
- 2024From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing
- 2024LHRS-Bot-Nova: Improved Multimodal Large Language Model for Remote Sensing Vision-Language Interpretation
- 2025DOFA-CLIP: Multimodal Vision-Language Foundation Models for Earth Observation
- 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs
- 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey