mlsanityData to 7 Oct 2026

SkyNative: A Native Multimodal Architecture for Remote Sensing Vision-Language Understanding

arXiv 2605.17949 ↗First posted 18 May 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Remote sensing vision-language models (RS-VLMs) commonly employ a pretrained vision encoder and a projection module to map image features into the token space of a large language model. Although effective, this modular RS-VLMs separates visual representation from language reasoning, potentially limiting the direct involvement of fine-grained visual evidence in complex spatial inference. This challenge is particularly relevant to remote sensing imagery, which often covers broad geographic areas and contains multi-scale objects, dense target distributions, and intricate spatial layouts. In this paper, we propose SkyNative, the first study to explore a native multimodal architecture for remote sensing vision-language tasks. SkyNative converts remote sensing images into visual tokens through a lightweight patch embedding module and places them together with text tokens in a shared autoregressive sequence, allowing textual tokens to directly access the preceding visual context. To accommodate the heterogeneous characteristics of the two modalities, we further adopt a modality-aware decoupling mechanism that applies modality-specific projections, normalization, and feed-forward transformations while processing both modalities through shared causal self-attention. Extensive experiments demonstrate SkyNative's strong capabilities in dense small-object perception, large-format contextual understanding, complex reasoning, and robustness, with scores of 68.93%, 47.40%, and 63.43% on HRRSD, RSHR reasoning, and OmniEarth, respectively. These results suggest that the native VLM architecture explored in SkyNative represents a promising approach to RS vision-language modeling.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 21 of its 34 references that are in the map. First posted on arXiv 18 May 2026.

Builds on

21 of 34 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks10 Mar
  2. 2025GeoLLaVA-8K: Scaling Remote-Sensing Multimodal Large Language Models to 8K Resolution27 May
  3. 2025When Large Vision-Language Model Meets Large Remote Sensing Imagery: Coarse-to-Fine Text-Guided Token Pruning10 Mar
  4. 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensing23 Jan
  5. 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
  6. 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
  7. 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun
  8. 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
  9. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov

Other references · 12

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  3. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  4. 2024DeepSeek-VL2: Mixture-of-Experts Vision-Language Models for Advanced Multimodal Understandingcited by 559
  5. 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
  6. 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 284
  7. 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 197
  8. 2020FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understandingcited by 181
  9. 2024VoCoT: Unleashing Visually Grounded Multi-Step Reasoning in Large Multi-Modal Modelscited by 42
  10. 2025ZoomEarth: Active Perception for Ultra-High-Resolution Geospatial Vision-Language Taskscited by 19
  11. 2026Foundation Models in Remote Sensing: Evolving from Unimodality to Multimodalitycited by 12
  12. 2025BREEN: Bridge Data-Efficient Encoder-Free Multimodal Learning with Learnable Queriescited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model
  2. 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
  3. 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives
  4. 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs
  5. 2024From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing
  6. 2024RSUniVLM: A Unified Vision Language Model for Remote Sensing via Granularity-oriented Mixture of Experts
  7. 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe
  8. 2024RSTeller: Scaling Up Visual Language Modeling in Remote Sensing with Rich Linguistic Semantics from Openly Available Data and Large Language Models