# LaVIDE: Language-Prompted Satellite Change Detection via Map-Image Alignment

arXiv: https://arxiv.org/abs/2411.19758 · HTML: https://mlsanity.com/paper/2411.19758/

## Key facts

- Cited by 1 papers in the map (data through 14 Oct 2026).
- Builds on 23 of its 36 references that are in the map.
- First posted on arXiv 29 Nov 2024.

## Builds on (most cited first, 23 of 23)

- [Learning Transferable Visual Models From Natural Language Supervision](https://mlsanity.com/paper/2103.00020/) (2021)
- [SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformers](https://mlsanity.com/paper/2105.15203/) (2021)
- [Learning to Prompt for Vision-Language Models](https://mlsanity.com/paper/2109.01134/) (2021)
- [Rethinking Semantic Segmentation from a Sequence-to-Sequence Perspective with Transformers](https://mlsanity.com/paper/2012.15840/) (2020)
- [Unified Perceptual Parsing for Scene Understanding](https://mlsanity.com/paper/1807.10221/) (2018)
- [Remote Sensing Image Change Detection with Transformers](https://mlsanity.com/paper/2103.00208/) (2021)
- [A Transformer-Based Siamese Network for Change Detection](https://mlsanity.com/paper/2201.01293/) (2022)
- [RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing](https://mlsanity.com/paper/2306.11300/) (2023)
- [ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Model](https://mlsanity.com/paper/2404.03425/) (2024)
- [Changer: Feature Interaction is What You Need for Change Detection](https://mlsanity.com/paper/2209.08290/) (2022)
- [DynamicEarthNet: Daily Multi-Spectral Satellite Dataset for Semantic Change Segmentation](https://mlsanity.com/paper/2203.12560/) (2022)
- [Change is Everywhere: Single-Temporal Supervised Object Change Detection in Remote Sensing Imagery](https://mlsanity.com/paper/2108.07002/) (2021)
- [CDMamba: Incorporating Local Clues into Mamba for Remote Sensing Image Binary Change Detection](https://mlsanity.com/paper/2406.04207/) (2024)
- [Fully Convolutional Change Detection Framework with Generative Adversarial Network for Unsupervised, Weakly Supervised and Regional Supervised Change Detection](https://mlsanity.com/paper/2201.06030/) (2022)
- [Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Model](https://mlsanity.com/paper/2406.17998/) (2024)
- [Distilling Large Vision-Language Model with Out-of-Distribution Generalizability](https://mlsanity.com/paper/2307.03135/) (2023)
- [Change Guiding Network: Incorporating Change Prior to Guide Change Detection in Remote Sensing Imagery](https://mlsanity.com/paper/2404.09179/) (2024)
- [Detecting Building Changes with Off-Nadir Aerial Images](https://mlsanity.com/paper/2301.10922/) (2023)
- [Joint Learning from Earth Observation and OpenStreetMap Data to Get Faster Better Semantic Maps](https://mlsanity.com/paper/1705.06057/) (2017)
- [MapFormer: Boosting Change Detection by Using Pre-change Information](https://mlsanity.com/paper/2303.17859/) (2023)
- [SAAN: Similarity-aware attention flow network for change detection with VHR remote sensing images](https://mlsanity.com/paper/2308.14570/) (2023)
- [Change Detection Between Optical Remote Sensing Imagery and Map Data via Segment Anything Model (SAM)](https://mlsanity.com/paper/2401.09019/) (2024)
- [ObjFormer: Learning Land-Cover Changes From Paired OSM Data and Optical High-Resolution Imagery via Object-Guided Transformer](https://mlsanity.com/paper/2310.02674/) (2023)

## Built on by (most cited first, 1 of 1)

- [FootprintNet: State-Transition-Guided Dynamic Footprint Learning for Multi-temporal Remote Sensing Change Detection](https://mlsanity.com/paper/2607.27969/) (2026)

## Abstract (arXiv)

Remote sensing change detection based on a map reference and an up-to-date image boosts timely observation of the Earth's surface when earlier images are lacking for comparison. However, the semantic gap between high-level map categories and low-level image details hinders the extraction of homogeneous features for robust temporal association in change detection. Unlike conventional approaches that either compare pixel-level visual similarity or propagate segmentation errors, textcolorblackwe propose a novel framework, underlineLanguage-underlineVIsion underlineDiscriminator for dunderlineEtecting changes, LaVIDE, which bridges the semantic gap between high-level map categories and low-level image details using language as an intermediary. Specifically, we introduce it restricted prompt learning to generate context-aware textual prompts that align map semantics with image content, and an it object-aware embedding enhancement strategy to integrate object-level attributes (e.g., shape, boundary) into map representations. These components enable robust cross-modal alignment within a unified language-vision feature space. Extensive experiments on four benchmarks, DynamicEarthNet, HRSCD, BANDON, and SECOND, demonstrate that LaVIDE outperforms state-of-the-art methods by significant margins, achieving 18.4% and 5.2% improvements in IoU on multi-class and single-class change detection tasks, respectively. Our framework not only advances the accuracy of map-image change detection but also provides a practical solution for rapid map updating with minimal human intervention, promising broad impacts in urban planning, disaster assessment, and ecological conservation. Code and datasets are available at: https://github.com/ShuGuoJ/LAVIDE.git.
