mlsanityData to 14 Oct 2026

DeltaVLM: Interactive Remote Sensing Image Change Analysis via Instruction-guided Difference Perception

arXiv 2507.22346 ↗First posted 30 Jul 2025cs.CVcited by 6

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Accurate interpretation of land-cover changes in multi-temporal satellite imagery is critical for real-world scenarios. However, existing methods typically provide only one-shot change masks or static captions, limiting their ability to support interactive, query-driven analysis. In this work, we introduce remote sensing image change analysis (RSICA) as a new paradigm that combines the strengths of change detection and visual question answering to enable multi-turn, instruction-guided exploration of changes in bi-temporal remote sensing images. To support this task, we construct ChangeChat-105k, a large-scale instruction-following dataset, generated through a hybrid rule-based and GPT-assisted process, covering six interaction types: change captioning, classification, quantification, localization, open-ended question answering, and multi-turn dialogues. Building on this dataset, we propose DeltaVLM, an end-to-end architecture tailored for interactive RSICA. DeltaVLM features three innovations: (1) a fine-tuned bi-temporal vision encoder to capture temporal differences; (2) a visual difference perception module with a cross-semantic relation measuring (CSRM) mechanism to interpret changes; and (3) an instruction-guided Q-former to effectively extract query-relevant difference information from visual changes, aligning them with textual instructions. We train DeltaVLM on ChangeChat-105k using a frozen large language model, adapting only the vision and alignment modules to optimize efficiency. Extensive experiments and ablation studies demonstrate that DeltaVLM achieves state-of-the-art performance on both single-turn captioning and multi-turn interactive change analysis, outperforming existing multimodal large language models and remote sensing vision-language models. Code, dataset and pre-trained weights are available at https://github.com/hanlinwu/DeltaVLM.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 36 of its 68 references that are in the map. First posted on arXiv 30 Jul 2025.

Builds on

36 of 68 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024CDChat: A Large Multimodal Model for Remote Sensing Change Description24 Sep
  2. 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model18 Jan
  3. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
  4. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
  5. 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing20 Jun

Other references · 31

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
  5. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  6. 2023Visual Instruction Tuningcited by 7,869
  7. 2024GPT-4o System Cardcited by 4,588
  8. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  9. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  10. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  11. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
  12. 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
19 more
  1. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  2. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  3. 2015VQA: Visual Question Answeringcited by 2,506
  4. 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
  5. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
  6. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  7. 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
  8. 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 691
  9. 2018Fully Convolutional Siamese Networks for Change Detectioncited by 306
  10. 2021Remote Sensing Image Change Detection with Transformerscited by 306
  11. 2016Image Captioning with Semantic Attentioncited by 260
  12. 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 203
  13. 2024Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysiscited by 63
  14. 2023EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answeringcited by 52
  15. 2023Progressive Scale-aware Network for Remote sensing Image Change Captioningcited by 27
  16. 2024ChangeChat: An Interactive Model for Remote Sensing Change Analysis via Multimodal Instruction Tuningcited by 23
  17. 2024Semantic-CC: Boosting Remote Sensing Image Change Captioning via Foundational Knowledge and Semantic Guidancecited by 17
  18. 2024A Lightweight Sparse Focus Transformer for Remote Sensing Image Change Captioningcited by 13
  19. 2025A Survey of Sample-Efficient Deep Learning for Change Detection in Remote Sensing: Tasks, Strategies, and Challengescited by 9

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 5.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Comprehensive Interactive Change Understanding in Remote Sensing: A Large-scale Dataset and Dual-granularity Enhanced VLM
  2. 2026Decoding the Delta: Unifying Remote Sensing Change Detection and Understanding with Multimodal Large Language Models
  3. 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey
  4. 2025ViLaCD-R1: A Vision-Language Framework for Semantic Change Detection in Remote Sensing
  5. 2026RSRCC: A Remote Sensing Regional Change Comprehension Benchmark Constructed via Retrieval-Augmented Best-of-N Ranking
  6. 2026Selective Tool Use for Agentic Change Visual Question Answering in Remote Sensing
  7. 2026JL1-CC&QA: Extending the JL1-CD Benchmark with Change Captioning and Question Answering
  8. 2025BTCChat: Advancing Remote Sensing Bi-temporal Change Captioning with Multimodal Large Language Model