AVION: Aerial Vision-Language Instruction from Offline Teacher to Prompt-Tuned Network
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Adapting vision-language models to remote sensing imagery remains challenging due to two key factors: limited semantic coverage in textual representations and insufficient adaptability of visual features. These issues are particularly significant in aerial scenes, which involve various visual appearances and fine-grained object distinctions. We propose AVION, a knowledge distillation framework tailored for remote sensing adaptation of vision-language models. The teacher module constructs semantically rich textual prototypes by collecting descriptions from a large language model and verifying validity using remote sensing image features. The student module integrates lightweight and learnable prompts into both vision and language encoders, guided by the teacher to align embeddings and their cross-modal relationships. Once trained, the student operates independently during inference. Experiments on six optical remote sensing benchmarks show that AVION improves few-shot classification and base-class accuracy without degrading generalization to novel categories. It also enhances mean recall for cross-modal retrieval, with minimal additional trainable parameters.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 32 of its 40 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
32 of 40 references.
Closest ancestors · 3
Same direction, newest first
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing20 Jun
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensing19 Jun
- 2023APPLeNet: Visual Attention Parameterized Prompt Learning for Few-Shot Remote Sensing Image Generalization using CLIP12 Apr
Other references · 29
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2021Learning to Prompt for Vision-Language Modelscited by 2,269
- 2022Visual Prompt Tuningcited by 1,674
- 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
- 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
- 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,021
- 2023A Survey on Multimodal Large Language Modelscited by 898
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
17 more
- 2022MaPLe: Multi-modal Prompt Learningcited by 685
- 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 626
- 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 572
- 2022Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classificationcited by 355
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
- 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 195
- 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 185
- 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 180
- 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 148
- 2017PatternNet: A Benchmark Dataset for Performance Evaluation of Remote Sensing Image Retrievalcited by 96
- 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
- 2024PromptKD: Unsupervised Prompt Distillation for Vision-Language Modelscited by 72
- 2025MMRL: Multi-Modal Representation Learning for Vision-Language Modelscited by 38
- 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodalitycited by 18
- 2025Prompt-CAM: Making Vision Transformers Interpretable for Fine-Grained Analysiscited by 12
- 2023MVP: Meta Visual Prompt Tuning for Few-Shot Remote Sensing Image Scene Classificationcited by 7
- 2025PeftCD: Leveraging Vision Foundation Models with Parameter-Efficient Fine-Tuning for Remote Sensing Change Detectioncited by 5
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SkyNative: A Native Multimodal Architecture for Remote Sensing Vision-Language Understanding
- 2025Falcon: A Remote Sensing Vision-Language Foundation Model (Technical Report)
- 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives
- 2025Efficient Few-Shot Learning in Remote Sensing: Fusing Vision and Vision-Language Models
- 2025A Benchmark for Multi-Lingual Vision-Language Learning in Remote Sensing Image Captioning
- 2026OSMDA: OpenStreetMap-based Domain Adaptation for Remote Sensing VLMs
- 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model
- 2025Cross-modal Context-aware Learning for Visual Prompt Guided Multimodal Image Understanding in Remote Sensing