RAH-VLA: Resolution-Adaptive Hierarchical Vision-Language Alignment for Multimodal Remote Sensing Understanding
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Multimodal vision-language modeling has emerged as a promising paradigm for remote sensing (RS) image understanding. However, existing methods are limited by fixed-resolution visual processing and single-scale vision-language alignment, making it difficult to simultaneously preserve fine-grained details and maintain semantic consistency across different spatial granularities. To address these challenges, we propose RAH-VLA, a Resolution-Adaptive Hierarchical Vision-Language Alignment framework for multimodal remote sensing understanding. Specifically, a Dynamic Resolution Input Strategy (DRIS) is developed to enable resolution-adaptive visual representations, while a Multi-scale Vision-Language Alignment Mechanism (MS-VLAM) is introduced to establish hierarchical semantic correspondence across object-level, region-level, and global-level representations. Extensive experiments on multiple remote sensing benchmarks demonstrate that RAH-VLA consistently improves image captioning, visual grounding, and cross-modal reasoning performance while reducing computational redundancy. Qualitative analyses further illustrate the effectiveness of the proposed resolution-adaptive perception and hierarchical vision-language alignment mechanisms, as well as the cross-modality generalization capability of the proposed framework. Overall, RAH-VLA provides an effective and scalable solution for multimodal remote sensing interpretation, offering a practical pathway toward efficient and semantically robust RS vision-language models.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 31 of its 68 references that are in the map. First posted on arXiv 29 Dec 2025.
Builds on
31 of 68 references.
Closest ancestors · 10
Same direction, newest first
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May
- 2025HyperCap: Hyperspectral Land Cover Captioning Dataset for Vision Language Models18 May
- 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey3 Dec
- 2024RS-MoE: A Vision-Language Model with Mixture of Experts for Remote Sensing Image Captioning and Visual Question Answering3 Nov
- 2024RSTeller: Scaling Up Visual Language Modeling in Remote Sensing with Rich Linguistic Semantics from Openly Available Data and Large Language Models27 Aug
- 2024Mind the Modality Gap: Towards a Remote Sensing Vision-Language Model via Cross-modal Alignment15 Feb
- 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model18 Jan
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
- 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trends9 May
Other references · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2017Non-local Neural Networkscited by 2,290
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 646
- 2021Conformer: Local Features Coupling Global Representations for Visual Recognitioncited by 164
- 2022Deep Learning in Multimodal Remote Sensing Data Fusion: A Comprehensive Reviewcited by 73
- 2024Multimodal Alignment and Fusion: A Surveycited by 73
9 more
- 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 66
- 2023SAM-Assisted Remote Sensing Imagery Semantic Segmentation with Object and Boundary Constraintscited by 35
- 2024Large Language Models for Captioning and Retrieving Remote Sensing Imagescited by 30
- 2024A Unified Framework with Multimodal Fine-tuning for Remote Sensing Semantic Segmentationcited by 15
- 2022Scale-Semantic Joint Decoupling Network for Image-text Retrieval in Remote Sensingcited by 6
- 2023AllSpark: A Multimodal Spatio-Temporal General Intelligence Model with Ten Modalities via Language as a Reference Frameworkcited by 6
- 2025Self-Supervised Cross-Modal Text-Image Time Series Retrieval in Remote Sensingcited by 3
- 2018A CNN-based Spatial Feature Fusion Algorithm for Hyperspectral Imagery Classificationcited by 2
- 2025MGCR-Net:Multimodal Graph-Conditioned Vision-Language Reconstruction Network for Remote Sensing Change Detectioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs
- 2026SkyNative: A Native Multimodal Architecture for Remote Sensing Vision-Language Understanding
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
- 2024Aquila: A Hierarchically Aligned Visual-Language Model for Enhanced Remote Sensing Image Comprehension
- 2025Remote Sensing Large Vision-Language Model: Semantic-augmented Multi-level Alignment and Semantic-aware Expert Modeling
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe
- 2026GeoAlignCLIP: Enhancing Fine-Grained Vision-Language Alignment in Remote Sensing via Multi-Granular Consistency Learning
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model