SkyMoE: A Vision-Language Foundation Model for Enhancing Geospatial Interpretation with Mixture of Experts
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
also in 1 more
Abstract (arXiv)
The emergence of large vision-language models (VLMs) has significantly enhanced the efficiency and flexibility of geospatial interpretation. However, general-purpose VLMs remain suboptimal for remote sensing (RS) tasks. Existing geospatial VLMs typically adopt a unified modeling strategy and struggle to differentiate between task types and interpretation granularities, limiting their ability to balance local detail perception and global contextual understanding. In this paper, we present SkyMoE, a Mixture-of-Experts (MoE) vision-language model tailored for multimodal, multi-task RS interpretation. SkyMoE employs an adaptive router that generates task- and granularity-aware routing instructions, enabling specialized large language model experts to handle diverse sub-tasks. To further promote expert decoupling and granularity sensitivity, we introduce a context-disentangled augmentation strategy that creates contrastive pairs between local and global features, guiding experts toward level-specific representation learning. We also construct MGRS-Bench, a comprehensive benchmark covering multiple RS interpretation tasks and granularity levels, to evaluate generalization in complex scenarios. Extensive experiments on 21 public datasets demonstrate that SkyMoE achieves state-of-the-art performance across tasks, validating its adaptability, scalability, and superior multi-granularity understanding in remote sensing.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 25 of its 47 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
25 of 47 references.
Closest ancestors · 10
Same direction, newest first
- 2025Falcon: A Remote Sensing Vision-Language Foundation Model (Technical Report)14 Mar
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
- 2024RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Experts7 Dec
- 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Grounding16 Nov
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
- 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
Other references · 15
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,131
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2023HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in Hugging Facecited by 1,173
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 622
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 339
- 2020Detection and Tracking Meet Drones Challengecited by 261
- 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 197
- 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 195
- 2024Agent AI: Surveying the Horizons of Multimodal Interactioncited by 167
3 more
- 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
- 2017Learning to Rank Question Answer Pairs with Holographic Dual LSTM Architecturecited by 14
- 2023Enhancing Social Decision-Making of Autonomous Vehicles: A Mixed-Strategy Game Approach With Interaction Orientation Identificationcited by 5
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMscited by 7
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Taskscited by 3
- 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervisioncited by 2
- 2026Mixture-of-Experts in Remote Sensing: A Surveycited by 0
- 2026SenseBench: A Benchmark for Remote Sensing Low-Level Visual Perception and Description in Large Vision-Language Modelscited by 0
- 2026SA-GEM: Scale-Adaptive and Geospatial Evidence-Modulated Token Pruning for Efficient Remote Sensing Large Vision-Language Modelscited by 0
- 2026SA-GEM: Scale-Adaptive and Geospatial Evidence-Modulated Token Pruning for Efficient Remote Sensing Large Vision-Language Models15 Aug 2026
- 2026SenseBench: A Benchmark for Remote Sensing Low-Level Visual Perception and Description in Large Vision-Language Models11 May 2026
- 2026RemoteAgent: Bridging Vague Human Intents and Earth Observation with RL-based Agentic MLLMs9 Apr 2026
- 2026Mixture-of-Experts in Remote Sensing: A Survey3 Apr 2026
- 2026GeoSolver: Scaling Test-Time Reasoning in Remote Sensing with Fine-Grained Process Supervision10 Mar 2026
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks10 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026SkyNative: A Native Multimodal Architecture for Remote Sensing Vision-Language Understanding
- 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe
- 2025GeoZero: Incentivizing Reasoning from Scratch on Geospatial Scenes
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks
- 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model
- 2025GeoViS: Geospatially Rewarded Visual Search for Remote Sensing Visual Grounding