# Unsupervised Multimodal Change Detection Based on Structural Relationship Graph Representation Learning

arXiv: https://arxiv.org/abs/2210.00941 · HTML: https://mlsanity.com/paper/2210.00941/

## Key facts

- Cited by 12 papers in the map (data through 14 Oct 2026).
- Builds on 22 of its 87 references that are in the map.
- First posted on arXiv 3 Oct 2022.

## Builds on (most cited first, 22 of 22)

- [Semi-Supervised Classification with Graph Convolutional Networks](https://mlsanity.com/paper/1609.02907/) (2016)
- [Graph Attention Networks](https://mlsanity.com/paper/1710.10903/) (2017)
- [CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Features](https://mlsanity.com/paper/1905.04899/) (2019)
- [Convolutional Neural Networks on Graphs with Fast Localized Spectral Filtering](https://mlsanity.com/paper/1606.09375/) (2016)
- [Simplifying Graph Convolutional Networks](https://mlsanity.com/paper/1902.07153/) (2019)
- [Deep learning in remote sensing: a review](https://mlsanity.com/paper/1710.03959/) (2017)
- [Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learning](https://mlsanity.com/paper/1908.02441/) (2019)
- [Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagery](https://mlsanity.com/paper/1803.02642/) (2018)
- [Unsupervised Deep Slow Feature Analysis for Change Detection in Multi-Temporal Remote Sensing Images](https://mlsanity.com/paper/1812.00645/) (2018)
- [GETNET: A General End-to-end Two-dimensional CNN Framework for Hyperspectral Image Change Detection](https://mlsanity.com/paper/1905.01662/) (2019)
- [Unsupervised Change Detection in Multi-temporal VHR Images Based on Deep Kernel PCA Convolutional Mapping Network](https://mlsanity.com/paper/1912.08628/) (2019)
- [Deep Image Translation with an Affinity-Based Change Prior for Unsupervised Multimodal Change Detection](https://mlsanity.com/paper/2001.04271/) (2020)
- [Unsupervised Image Regression for Heterogeneous Change Detection](https://mlsanity.com/paper/1909.05948/) (2019)
- [Dual-Tasks Siamese Transformer Framework for Building Damage Assessment](https://mlsanity.com/paper/2201.10953/) (2022)
- [Code-Aligned Autoencoders for Unsupervised Change Detection in Multimodal Remote Sensing Images](https://mlsanity.com/paper/2004.07011/) (2020)
- [A Multiscale Graph Convolutional Network for Change Detection in Homogeneous and Heterogeneous Remote Sensing Images](https://mlsanity.com/paper/2102.08041/) (2021)
- [Hyperspectral Anomaly Change Detection Based on Auto-encoder](https://mlsanity.com/paper/2010.14119/) (2020)
- [Change Detection in Multi-temporal VHR Images Based on Deep Siamese Multi-scale Convolutional Networks](https://mlsanity.com/paper/1906.11479/) (2019)
- [Change Detection in Heterogeneous Optical and SAR Remote Sensing Images via Deep Homogeneous Feature Fusion](https://mlsanity.com/paper/2004.03830/) (2020)
- [Change Detection from Synthetic Aperture Radar Images via Graph-Based Knowledge Supplement Network](https://mlsanity.com/paper/2201.08954/) (2022)
- [Adaptive Local Structure Consistency based Heterogeneous Remote Sensing Change Detection](https://mlsanity.com/paper/2008.12958/) (2020)
- [An Investigation of Traffic Density Changes inside Wuhan during the COVID-19 Epidemic with GF-2 Time-Series Images](https://mlsanity.com/paper/2006.16098/) (2020)

## Built on by (most cited first, 12 of 12)

- [ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Model](https://mlsanity.com/paper/2404.03425/) (2024)
- [Change Guiding Network: Incorporating Change Prior to Guide Change Detection in Remote Sensing Imagery](https://mlsanity.com/paper/2404.09179/) (2024)
- [Exchange means change: an unsupervised single-temporal change detection framework based on intra- and inter-image patch exchange](https://mlsanity.com/paper/2310.00689/) (2023)
- [Change Detection Between Optical Remote Sensing Imagery and Map Data via Segment Anything Model (SAM)](https://mlsanity.com/paper/2401.09019/) (2024)
- [ObjFormer: Learning Land-Cover Changes From Paired OSM Data and Optical High-Resolution Imagery via Object-Guided Transformer](https://mlsanity.com/paper/2310.02674/) (2023)
- [T-UNet: Triplet UNet for Change Detection in High-Resolution Remote Sensing Images](https://mlsanity.com/paper/2308.02356/) (2023)
- [Transformer-based Multimodal Change Detection with Multitask Consistency Constraints](https://mlsanity.com/paper/2310.09276/) (2023)
- [NN-Copula-CD: A Copula-Guided Interpretable Neural Network for Change Detection in Heterogeneous Remote Sensing Images](https://mlsanity.com/paper/2303.17448/) (2023)
- [EMS-Net: Efficient Multi-Temporal Self-Attention For Hyperspectral Change Detection](https://mlsanity.com/paper/2303.13753/) (2023)
- [S2C: Learning Noise-Resistant Differences for Unsupervised Change Detection in Multimodal Remote Sensing Images](https://mlsanity.com/paper/2502.12604/) (2025)
- [Quantum Information-Empowered Graph Neural Network for Hyperspectral Change Detection](https://mlsanity.com/paper/2411.07608/) (2024)
- [ChangeQuery: Advancing Remote Sensing Change Analysis for Natural and Human-Induced Disasters from Visual Detection to Semantic Understanding](https://mlsanity.com/paper/2604.22333/) (2026)

## Abstract (arXiv)

Unsupervised multimodal change detection is a practical and challenging topic that can play an important role in time-sensitive emergency applications. To address the challenge that multimodal remote sensing images cannot be directly compared due to their modal heterogeneity, we take advantage of two types of modality-independent structural relationships in multimodal images. In particular, we present a structural relationship graph representation learning framework for measuring the similarity of the two structural relationships. Firstly, structural graphs are generated from preprocessed multimodal image pairs by means of an object-based image analysis approach. Then, a structural relationship graph convolutional autoencoder (SR-GCAE) is proposed to learn robust and representative features from graphs. Two loss functions aiming at reconstructing vertex information and edge information are presented to make the learned representations applicable for structural relationship similarity measurement. Subsequently, the similarity levels of two structural relationships are calculated from learned graph representations and two difference images are generated based on the similarity levels. After obtaining the difference images, an adaptive fusion strategy is presented to fuse the two difference images. Finally, a morphological filtering-based postprocessing approach is employed to refine the detection results. Experimental results on five datasets with different modal combinations demonstrate the effectiveness of the proposed method.
