mlsanityData to 7 Oct 2026

AVION: Aerial Vision-Language Instruction from Offline Teacher to Prompt-Tuned Network

arXiv 2603.12659 ↗First posted 13 Mar 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Adapting vision-language models to remote sensing imagery remains challenging due to two key factors: limited semantic coverage in textual representations and insufficient adaptability of visual features. These issues are particularly significant in aerial scenes, which involve various visual appearances and fine-grained object distinctions. We propose AVION, a knowledge distillation framework tailored for remote sensing adaptation of vision-language models. The teacher module constructs semantically rich textual prototypes by collecting descriptions from a large language model and verifying validity using remote sensing image features. The student module integrates lightweight and learnable prompts into both vision and language encoders, guided by the teacher to align embeddings and their cross-modal relationships. Once trained, the student operates independently during inference. Experiments on six optical remote sensing benchmarks show that AVION improves few-shot classification and base-class accuracy without degrading generalization to novel categories. It also enhances mean recall for cross-modal retrieval, with minimal additional trainable parameters.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 32 of its 40 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

32 of 40 references.

Closest ancestors · 3

Same direction, newest first

  1. 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing20 Jun
  2. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensing19 Jun
  3. 2023APPLeNet: Visual Attention Parameterized Prompt Learning for Few-Shot Remote Sensing Image Generalization using CLIP12 Apr

Other references · 29

  1. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,069
  2. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,848
  3. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  4. 2021Learning to Prompt for Vision-Language Modelscited by 2,269
  5. 2022Visual Prompt Tuningcited by 1,674
  6. 2021Align before Fuse: Vision and Language Representation Learning with Momentum Distillationcited by 1,612
  7. 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
  8. 2022Conditional Prompt Learning for Vision-Language Modelscited by 1,427
  9. 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,265
  10. 2021CLIP-Adapter: Better Vision-Language Models with Feature Adapterscited by 1,021
  11. 2023A Survey on Multimodal Large Language Modelscited by 898
  12. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
17 more
  1. 2022MaPLe: Multi-modal Prompt Learningcited by 685
  2. 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 626
  3. 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 572
  4. 2022Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classificationcited by 355
  5. 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
  6. 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 195
  7. 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 185
  8. 2023RSPrompter: Learning to Prompt for Remote Sensing Instance Segmentation based on Visual Foundation Modelcited by 180
  9. 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 148
  10. 2017PatternNet: A Benchmark Dataset for Performance Evaluation of Remote Sensing Image Retrievalcited by 96
  11. 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
  12. 2024PromptKD: Unsupervised Prompt Distillation for Vision-Language Modelscited by 72
  13. 2025MMRL: Multi-Modal Representation Learning for Vision-Language Modelscited by 38
  14. 2025A Survey on Remote Sensing Foundation Models: From Vision to Multimodalitycited by 18
  15. 2025Prompt-CAM: Making Vision Transformers Interpretable for Fine-Grained Analysiscited by 12
  16. 2023MVP: Meta Visual Prompt Tuning for Few-Shot Remote Sensing Image Scene Classificationcited by 7
  17. 2025PeftCD: Leveraging Vision Foundation Models with Parameter-Efficient Fine-Tuning for Remote Sensing Change Detectioncited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026SkyNative: A Native Multimodal Architecture for Remote Sensing Vision-Language Understanding
  2. 2025Falcon: A Remote Sensing Vision-Language Foundation Model (Technical Report)
  3. 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives
  4. 2025Efficient Few-Shot Learning in Remote Sensing: Fusing Vision and Vision-Language Models
  5. 2025A Benchmark for Multi-Lingual Vision-Language Learning in Remote Sensing Image Captioning
  6. 2026OSMDA: OpenStreetMap-based Domain Adaptation for Remote Sensing VLMs
  7. 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model
  8. 2025Cross-modal Context-aware Learning for Visual Prompt Guided Multimodal Image Understanding in Remote Sensing