mlsanityData to 7 Oct 2026

ViewDelta: Scaling Scene Change Detection through Text-Conditioning

arXiv 2412.07612 ↗First posted 10 Dec 2024cs.CVcited by 4

Not on the map. Why?

Abstract (arXiv)

We introduce a generalized framework for Scene Change Detection (SCD) that addresses the core ambiguity of distinguishing "relevant" from "nuisance" changes, enabling effective joint training of a single model across diverse domains and applications. Existing methods struggle to generalize due to differences in dataset labeling, where changes such as vegetation growth or lane marking alterations may be labeled as relevant in one dataset and irrelevant in another. To resolve this ambiguity, we propose ViewDelta, a text conditioned change detection framework that uses natural language prompts to define relevant changes precisely, such as a single attribute, a specific set of classes, or all observable differences. To facilitate training in this paradigm, we release the Conditional Change Segmentation dataset (CSeg), the first large-scale synthetic dataset for text conditioned SCD, consisting of over 500,000 image pairs with more than 300,000 unique textual prompts describing relevant changes. Experiments demonstrate that a single ViewDelta model trained jointly on CSeg, SYSU-CD, PSCD, VL-CMU-CD, and their unaligned variants achieves performance competitive with or superior to dataset specific models, highlighting text conditioning as a powerful approach for generalizable SCD. Our code and dataset are available at https://joshuakgao.github.io/viewdelta/.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Builds on 29 of its 56 references that are in the map. First posted on arXiv 10 Dec 2024.

Builds on

29 of 56 references.

References · 29

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2023Segment Anythingcited by 8,158
  5. 2020End-to-End Object Detection with Transformerscited by 7,384
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  7. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  8. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  9. 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 786
  10. 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 730
  11. 2023DataComp: In search of the next generation of multimodal datasetscited by 635
  12. 2018Fully Convolutional Siamese Networks for Change Detectioncited by 305
17 more
  1. 2021Remote Sensing Image Change Detection with Transformerscited by 305
  2. 2022A Transformer-Based Siamese Network for Change Detectioncited by 243
  3. 2019xBD: A Dataset for Assessing Building Damage from Satellite Imagerycited by 138
  4. 2024Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detectioncited by 122
  5. 2024ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Modelcited by 118
  6. 2024T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergycited by 94
  7. 2022Transformers in Remote Sensing: A Surveycited by 61
  8. 2018Weakly Supervised Silhouette-based Semantic Scene Change Detectioncited by 44
  9. 2023Change Detection Methods for Remote Sensing in the Last Decade: A Comprehensive Reviewcited by 41
  10. 2024Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Modelcited by 37
  11. 2021DR-TANet: Dynamic Receptive Temporal Attention Network for Street Scene Change Detectioncited by 32
  12. 2020Semantic Change Detection with Asymmetric Siamese Networkscited by 31
  13. 2022How to Reduce Change Detection to Semantic Segmentationcited by 28
  14. 2019Detecting Urban Changes with Recurrent Neural Networks from Multitemporal Sentinel-2 Datacited by 20
  15. 2023The Change You Want to See (Now in 3D)cited by 17
  16. 2024Towards Generalizable Scene Change Detectioncited by 17
  17. 2024Robust Scene Change Detection Using Visual Foundation Models and Cross-Attention Mechanismscited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 2.

4 papers.