mlsanityData to 7 Oct 2026

RAH-VLA: Resolution-Adaptive Hierarchical Vision-Language Alignment for Multimodal Remote Sensing Understanding

arXiv 2512.23243 ↗First posted 29 Dec 2025cs.CVcited by 1

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Multimodal vision-language modeling has emerged as a promising paradigm for remote sensing (RS) image understanding. However, existing methods are limited by fixed-resolution visual processing and single-scale vision-language alignment, making it difficult to simultaneously preserve fine-grained details and maintain semantic consistency across different spatial granularities. To address these challenges, we propose RAH-VLA, a Resolution-Adaptive Hierarchical Vision-Language Alignment framework for multimodal remote sensing understanding. Specifically, a Dynamic Resolution Input Strategy (DRIS) is developed to enable resolution-adaptive visual representations, while a Multi-scale Vision-Language Alignment Mechanism (MS-VLAM) is introduced to establish hierarchical semantic correspondence across object-level, region-level, and global-level representations. Extensive experiments on multiple remote sensing benchmarks demonstrate that RAH-VLA consistently improves image captioning, visual grounding, and cross-modal reasoning performance while reducing computational redundancy. Qualitative analyses further illustrate the effectiveness of the proposed resolution-adaptive perception and hierarchical vision-language alignment mechanisms, as well as the cross-modality generalization capability of the proposed framework. Overall, RAH-VLA provides an effective and scalable solution for multimodal remote sensing interpretation, offering a practical pathway toward efficient and semantically robust RS vision-language models.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 31 of its 68 references that are in the map. First posted on arXiv 29 Dec 2025.

Builds on

31 of 68 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May
  2. 2025HyperCap: Hyperspectral Land Cover Captioning Dataset for Vision Language Models18 May
  3. 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey3 Dec
  4. 2024RS-MoE: A Vision-Language Model with Mixture of Experts for Remote Sensing Image Captioning and Visual Question Answering3 Nov
  5. 2024RSTeller: Scaling Up Visual Language Modeling in Remote Sensing with Rich Linguistic Semantics from Openly Available Data and Large Language Models27 Aug
  6. 2024Mind the Modality Gap: Towards a Remote Sensing Vision-Language Model via Cross-modal Alignment15 Feb
  7. 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model18 Jan
  8. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
  9. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
  10. 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trends9 May

Other references · 21

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  5. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  6. 2017Non-local Neural Networkscited by 2,290
  7. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
  8. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  9. 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 646
  10. 2021Conformer: Local Features Coupling Global Representations for Visual Recognitioncited by 164
  11. 2022Deep Learning in Multimodal Remote Sensing Data Fusion: A Comprehensive Reviewcited by 73
  12. 2024Multimodal Alignment and Fusion: A Surveycited by 73
9 more
  1. 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 66
  2. 2023SAM-Assisted Remote Sensing Imagery Semantic Segmentation with Object and Boundary Constraintscited by 35
  3. 2024Large Language Models for Captioning and Retrieving Remote Sensing Imagescited by 30
  4. 2024A Unified Framework with Multimodal Fine-tuning for Remote Sensing Semantic Segmentationcited by 15
  5. 2022Scale-Semantic Joint Decoupling Network for Image-text Retrieval in Remote Sensingcited by 6
  6. 2023AllSpark: A Multimodal Spatio-Temporal General Intelligence Model with Ten Modalities via Language as a Reference Frameworkcited by 6
  7. 2025Self-Supervised Cross-Modal Text-Image Time Series Retrieval in Remote Sensingcited by 3
  8. 2018A CNN-based Spatial Feature Fusion Algorithm for Hyperspectral Imagery Classificationcited by 2
  9. 2025MGCR-Net:Multimodal Graph-Conditioned Vision-Language Reconstruction Network for Remote Sensing Change Detectioncited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs
  2. 2026SkyNative: A Native Multimodal Architecture for Remote Sensing Vision-Language Understanding
  3. 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
  4. 2024Aquila: A Hierarchically Aligned Visual-Language Model for Enhanced Remote Sensing Image Comprehension
  5. 2025Remote Sensing Large Vision-Language Model: Semantic-augmented Multi-level Alignment and Semantic-aware Expert Modeling
  6. 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe
  7. 2026GeoAlignCLIP: Enhancing Fine-Grained Vision-Language Alignment in Remote Sensing via Multi-Granular Consistency Learning
  8. 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model