DeltaVLM: Interactive Remote Sensing Image Change Analysis via Instruction-guided Difference Perception
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Accurate interpretation of land-cover changes in multi-temporal satellite imagery is critical for real-world scenarios. However, existing methods typically provide only one-shot change masks or static captions, limiting their ability to support interactive, query-driven analysis. In this work, we introduce remote sensing image change analysis (RSICA) as a new paradigm that combines the strengths of change detection and visual question answering to enable multi-turn, instruction-guided exploration of changes in bi-temporal remote sensing images. To support this task, we construct ChangeChat-105k, a large-scale instruction-following dataset, generated through a hybrid rule-based and GPT-assisted process, covering six interaction types: change captioning, classification, quantification, localization, open-ended question answering, and multi-turn dialogues. Building on this dataset, we propose DeltaVLM, an end-to-end architecture tailored for interactive RSICA. DeltaVLM features three innovations: (1) a fine-tuned bi-temporal vision encoder to capture temporal differences; (2) a visual difference perception module with a cross-semantic relation measuring (CSRM) mechanism to interpret changes; and (3) an instruction-guided Q-former to effectively extract query-relevant difference information from visual changes, aligning them with textual instructions. We train DeltaVLM on ChangeChat-105k using a frozen large language model, adapting only the vision and alignment modules to optimize efficiency. Extensive experiments and ablation studies demonstrate that DeltaVLM achieves state-of-the-art performance on both single-turn captioning and multi-turn interactive change analysis, outperforming existing multimodal large language models and remote sensing vision-language models. Code, dataset and pre-trained weights are available at https://github.com/hanlinwu/DeltaVLM.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 36 of its 68 references that are in the map. First posted on arXiv 30 Jul 2025.
Builds on
36 of 68 references.
Closest ancestors · 5
Same direction, newest first
- 2024CDChat: A Large Multimodal Model for Remote Sensing Change Description24 Sep
- 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model18 Jan
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing20 Jun
Other references · 31
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 12,049
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Visual Instruction Tuningcited by 7,869
- 2024GPT-4o System Cardcited by 4,588
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,057
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,780
19 more
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2015VQA: Visual Question Answeringcited by 2,506
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,375
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 691
- 2018Fully Convolutional Siamese Networks for Change Detectioncited by 306
- 2021Remote Sensing Image Change Detection with Transformerscited by 306
- 2016Image Captioning with Semantic Attentioncited by 260
- 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 203
- 2024Change-Agent: Towards Interactive Comprehensive Remote Sensing Change Interpretation and Analysiscited by 63
- 2023EarthVQA: Towards Queryable Earth via Relational Reasoning-Based Remote Sensing Visual Question Answeringcited by 52
- 2023Progressive Scale-aware Network for Remote sensing Image Change Captioningcited by 27
- 2024ChangeChat: An Interactive Model for Remote Sensing Change Analysis via Multimodal Instruction Tuningcited by 23
- 2024Semantic-CC: Boosting Remote Sensing Image Change Captioning via Foundational Knowledge and Semantic Guidancecited by 17
- 2024A Lightweight Sparse Focus Transformer for Remote Sensing Image Change Captioningcited by 13
- 2025A Survey of Sample-Efficient Deep Learning for Change Detection in Remote Sensing: Tasks, Strategies, and Challengescited by 9
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025SAM Guided Semantic and Motion Changed Region Mining for Remote Sensing Change Captioningcited by 3
- 2026Revisiting Change VQA in Remote Sensing with Structured and Native Multimodal Qwen Modelscited by 1
- 2026LBTCap: A Lightweight Bilateral Transformer for Real-Time Remote Sensing Image Change Captioningcited by 0
- 2026HIMEC: Directional Change Representation and Fixed-Interface Decoding for Remote Sensing Image Change Captioningcited by 0
- 2026When Do Frozen VLMs Respond to Image-Free Object-Token Edits? An Answer-Key-Free Protocol and What It Revealscited by 0
- 2026MGRL-RSCC: Multi-Granularity Reward Reinforcement Learning for Fine-Grained Remote Sensing Change Captioningcited by 0
- 2026When Do Frozen VLMs Respond to Image-Free Object-Token Edits? An Answer-Key-Free Protocol and What It Reveals3 Sep 2026
- 2026HIMEC: Directional Change Representation and Fixed-Interface Decoding for Remote Sensing Image Change Captioning12 Aug 2026
- 2026MGRL-RSCC: Multi-Granularity Reward Reinforcement Learning for Fine-Grained Remote Sensing Change Captioning9 Aug 2026
- 2026LBTCap: A Lightweight Bilateral Transformer for Real-Time Remote Sensing Image Change Captioning3 Jul 2026
- 2026Revisiting Change VQA in Remote Sensing with Structured and Native Multimodal Qwen Models20 Apr 2026
- 2025SAM Guided Semantic and Motion Changed Region Mining for Remote Sensing Change Captioning26 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2025Towards Comprehensive Interactive Change Understanding in Remote Sensing: A Large-scale Dataset and Dual-granularity Enhanced VLM
- 2026Decoding the Delta: Unifying Remote Sensing Change Detection and Understanding with Multimodal Large Language Models
- 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey
- 2025ViLaCD-R1: A Vision-Language Framework for Semantic Change Detection in Remote Sensing
- 2026RSRCC: A Remote Sensing Regional Change Comprehension Benchmark Constructed via Retrieval-Augmented Best-of-N Ranking
- 2026Selective Tool Use for Agentic Change Visual Question Answering in Remote Sensing
- 2026JL1-CC&QA: Extending the JL1-CD Benchmark with Change Captioning and Question Answering
- 2025BTCChat: Advancing Remote Sensing Bi-temporal Change Captioning with Multimodal Large Language Model