# UCDFormer: Unsupervised Change Detection Using a Transformer-driven Image Translation

arXiv: https://arxiv.org/abs/2308.01146 · HTML: https://mlsanity.com/paper/2308.01146/

## Key facts

- Cited by 5 papers in the map (data through 14 Oct 2026).
- Builds on 23 of its 84 references that are in the map.
- First posted on arXiv 2 Aug 2023.

## Builds on (most cited first, 23 of 23)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Adam: A Method for Stochastic Optimization](https://mlsanity.com/paper/1412.6980/) (2014)
- [An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale](https://mlsanity.com/paper/2010.11929/) (2020)
- [Very Deep Convolutional Networks for Large-Scale Image Recognition](https://mlsanity.com/paper/1409.1556/) (2014)
- [Swin Transformer: Hierarchical Vision Transformer using Shifted Windows](https://mlsanity.com/paper/2103.14030/) (2021)
- [Perceptual Losses for Real-Time Style Transfer and Super-Resolution](https://mlsanity.com/paper/1603.08155/) (2016)
- [Remote Sensing Image Change Detection with Transformers](https://mlsanity.com/paper/2103.00208/) (2021)
- [StyTr2: Image Style Transfer with Transformers](https://mlsanity.com/paper/2105.14576/) (2021)
- [Deep learning in remote sensing: a review](https://mlsanity.com/paper/1710.03959/) (2017)
- [DynamicEarthNet: Daily Multi-Spectral Satellite Dataset for Semantic Change Segmentation](https://mlsanity.com/paper/2203.12560/) (2022)
- [Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery](https://mlsanity.com/paper/1803.02642/) (2018)
- [Fully Convolutional Change Detection Framework with Generative Adversarial Network for Unsupervised, Weakly Supervised and Regional Supervised Change Detection](https://mlsanity.com/paper/2201.06030/) (2022)
- [Glance-and-Gaze Vision Transformer](https://mlsanity.com/paper/2106.02277/) (2021)
- [Unsupervised Deep Slow Feature Analysis for Change Detection in Multi-Temporal Remote Sensing Images](https://mlsanity.com/paper/1812.00645/) (2018)
- [GETNET: A General End-to-end Two-dimensional CNN Framework for Hyperspectral Image Change Detection](https://mlsanity.com/paper/1905.01662/) (2019)
- [Unsupervised Change Detection in Multi-temporal VHR Images Based on Deep Kernel PCA Convolutional Mapping Network](https://mlsanity.com/paper/1912.08628/) (2019)
- [Deep Image Translation with an Affinity-Based Change Prior for Unsupervised Multimodal Change Detection](https://mlsanity.com/paper/2001.04271/) (2020)
- [Unsupervised Change Detection Based on Image Reconstruction Loss](https://mlsanity.com/paper/2204.01200/) (2022)
- [Code-Aligned Autoencoders for Unsupervised Change Detection in Multimodal Remote Sensing Images](https://mlsanity.com/paper/2004.07011/) (2020)
- [Universal Domain Adaptation for Remote Sensing Image Scene Classification](https://mlsanity.com/paper/2301.11387/) (2023)
- [Unsupervised Change Detection in Satellite Images Using Convolutional Neural Networks](https://mlsanity.com/paper/1812.05815/) (2018)
- [Unsupervised Image-to-Image Translation with Stacked Cycle-Consistent Adversarial Networks](https://mlsanity.com/paper/1807.08536/) (2018)
- [Spatial Context Awareness for Unsupervised Change Detection in Optical Satellite Images](https://mlsanity.com/paper/2110.02068/) (2021)

## Built on by (most cited first, 5 of 5)

- [Large-scale flood modeling and forecasting with FloodCast](https://mlsanity.com/paper/2403.12226/) (2024)
- [Multi-task deep learning for large-scale building detail extraction from high-resolution satellite imagery](https://mlsanity.com/paper/2310.18899/) (2023)
- [Lightweight Change Detection in Heterogeneous Remote Sensing Images with Online All-Integer Pruning Training](https://mlsanity.com/paper/2405.01920/) (2024)
- [SHAZAM: Self-Supervised Change Monitoring for Hazard Detection and Mapping](https://mlsanity.com/paper/2503.00348/) (2025)
- [FM-ChangeNet: Learning Change through Pathwise Feature Transport](https://mlsanity.com/paper/2607.04750/) (2026)

## Abstract (arXiv)

Change detection (CD) by comparing two bi-temporal images is a crucial task in remote sensing. With the advantages of requiring no cumbersome labeled change information, unsupervised CD has attracted extensive attention in the community. However, existing unsupervised CD approaches rarely consider the seasonal and style differences incurred by the illumination and atmospheric conditions in multi-temporal images. To this end, we propose a change detection with domain shift setting for remote sensing images. Furthermore, we present a novel unsupervised CD method using a light-weight transformer, called UCDFormer. Specifically, a transformer-driven image translation composed of a light-weight transformer and a domain-specific affinity weight is first proposed to mitigate domain shift between two images with real-time efficiency. After image translation, we can generate the difference map between the translated before-event image and the original after-event image. Then, a novel reliable pixel extraction module is proposed to select significantly changed/unchanged pixel positions by fusing the pseudo change maps of fuzzy c-means clustering and adaptive threshold. Finally, a binary change map is obtained based on these selected pixel pairs and a binary classifier. Experimental results on different unsupervised CD tasks with seasonal and style changes demonstrate the effectiveness of the proposed UCDFormer. For example, compared with several other related methods, UCDFormer improves performance on the Kappa coefficient by more than 12%. In addition, UCDFormer achieves excellent performance for earthquake-induced landslide detection when considering large-scale applications. The code is available at urlhttps://github.com/zhu-xlab/UCDFormer
