mlsanityData to 14 Oct 2026

Continual Vision-Language Learning for Remote Sensing: Benchmarking and Analysis

arXiv 2604.00820 ↗First posted 1 Apr 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Current remote sensing vision-language models (RS VLMs) demonstrate impressive performance in image interpretation but rely on static training data, limiting their ability to accommodate continuously emerging sensing modalities and downstream tasks. This exposes a fundamental challenge: enabling RS VLMs to continually adapt without catastrophic forgetting. Despite its practical importance, the continual learning capability of RS VLMs remains underexplored, and no dedicated benchmark currently exists. In this work, we present CLeaRS, a comprehensive benchmark for continual vision-language learning in remote sensing. CLeaRS comprises 10 curated subsets with over 207k image-text pairs, spanning diverse interpretation tasks, sensing modalities, and application scenarios. We further define three evaluation protocols: long-horizon, modality-incremental, and task-incremental settings, to systematically assess continual adaptation. Extensive benchmarking of diverse vision-language models reveals catastrophic forgetting across all settings. Moreover, representative continual learning methods, when adapted to RS VLMs, exhibit limited effectiveness in handling task, instruction, and modality transitions. Our findings underscore the need for developing continual learning methods tailored to RS VLMs.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 27 of its 50 references that are in the map. First posted on arXiv 1 Apr 2026.

Builds on

27 of 50 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May
  2. 2025SARLANG-1M: A Benchmark for Vision-Language Modeling in SAR Image Understanding4 Apr
  3. 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensing18 Jul
  4. 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
  5. 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun
  6. 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
  7. 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
  8. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan
  9. 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model18 Jan
  10. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov

Other references · 17

  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
  3. 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 347
  4. 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 340
  5. 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 204
  6. 2020Drone-based RGB-Infrared Cross-Modality Vehicle Detection via Uncertainty-Aware Learningcited by 152
  7. 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 70
  8. 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 70
  9. 2024CoIN: A Benchmark of Continual Instruction tuNing for Multimodel Large Language Modelcited by 61
  10. 2024SARDet-100K: Towards Open-Source Benchmark and ToolKit for Large-Scale SAR Object Detectioncited by 48
  11. 2025SEFE: Superficial and Essential Forgetting Eliminator for Multimodal Continual Instruction Tuningcited by 33
  12. 2025MLLM-CL: Continual Learning for Multimodal Large Language Modelscited by 23
5 more
  1. 2023FireRisk: A Remote Sensing Dataset for Fire Risk Assessment with Benchmarks Using Supervised and Self-supervised Learningcited by 14
  2. 2024Popeye: A Unified Visual-Language Model for Multi-Source Ship Detection from Remote Sensing Imagerycited by 14
  3. 2021A Contrastive Distillation Approach for Incremental Semantic Segmentation in Aerial Imagescited by 6
  4. 2024Modality-Inconsistent Continual Learning of Multimodal Large Language Modelscited by 6
  5. 2025Merge then Realign: Simple and Effective Modality-Incremental Continual Learning for Multimodal LLMscited by 6

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe
  2. 2024Continual Panoptic Perception: Towards Multi-modal Incremental Interpretation of Remote Sensing Images
  3. 2025A Benchmark for Ultra-High-Resolution Remote Sensing MLLMs
  4. 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey
  5. 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing
  6. 2026VLRS-Bench: A Vision-Language Reasoning Benchmark for Remote Sensing
  7. 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
  8. 2026SkyNative: A Native Multimodal Architecture for Remote Sensing Vision-Language Understanding