Unsupervised Multimodal Change Detection Based on Structural Relationship Graph Representation Learning
Not on the map. Why?
Abstract (arXiv)
Unsupervised multimodal change detection is a practical and challenging topic that can play an important role in time-sensitive emergency applications. To address the challenge that multimodal remote sensing images cannot be directly compared due to their modal heterogeneity, we take advantage of two types of modality-independent structural relationships in multimodal images. In particular, we present a structural relationship graph representation learning framework for measuring the similarity of the two structural relationships. Firstly, structural graphs are generated from preprocessed multimodal image pairs by means of an object-based image analysis approach. Then, a structural relationship graph convolutional autoencoder (SR-GCAE) is proposed to learn robust and representative features from graphs. Two loss functions aiming at reconstructing vertex information and edge information are presented to make the learned representations applicable for structural relationship similarity measurement. Subsequently, the similarity levels of two structural relationships are calculated from learned graph representations and two difference images are generated based on the similarity levels. After obtaining the difference images, an adaptive fusion strategy is presented to fuse the two difference images. Finally, a morphological filtering-based postprocessing approach is employed to refine the detection results. Experimental results on five datasets with different modal combinations demonstrate the effectiveness of the proposed method.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Builds on 22 of its 87 references that are in the map. First posted on arXiv 3 Oct 2022.
Builds on
22 of 87 references.
References · 22
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2017Graph Attention Networkscited by 8,854
- 2019CutMix: Regularization Strategy to Train Strong Classifiers with Localizable Featurescited by 2,875
- 2016Convolutional Neural Networks on Graphs with Fast Localized Spectral Filteringcited by 2,085
- 2019Simplifying Graph Convolutional Networkscited by 1,470
- 2017Deep learning in remote sensing: a reviewcited by 128
- 2019Symmetric Graph Convolutional Autoencoder for Unsupervised Graph Representation Learningcited by 94
- 2018Learning Spectral-Spatial-Temporal Features via a Recurrent Convolutional Neural Network for Change Detection in Multispectral Imagerycited by 53
- 2018Unsupervised Deep Slow Feature Analysis for Change Detection in Multi-Temporal Remote Sensing Imagescited by 40
- 2019GETNET: A General End-to-end Two-dimensional CNN Framework for Hyperspectral Image Change Detectioncited by 37
- 2019Unsupervised Change Detection in Multi-temporal VHR Images Based on Deep Kernel PCA Convolutional Mapping Networkcited by 24
- 2020Deep Image Translation with an Affinity-Based Change Prior for Unsupervised Multimodal Change Detectioncited by 22
10 more
- 2019Unsupervised Image Regression for Heterogeneous Change Detectioncited by 21
- 2022Dual-Tasks Siamese Transformer Framework for Building Damage Assessmentcited by 19
- 2020Code-Aligned Autoencoders for Unsupervised Change Detection in Multimodal Remote Sensing Imagescited by 17
- 2021A Multiscale Graph Convolutional Network for Change Detection in Homogeneous and Heterogeneous Remote Sensing Imagescited by 12
- 2020Hyperspectral Anomaly Change Detection Based on Auto-encodercited by 11
- 2019Change Detection in Multi-temporal VHR Images Based on Deep Siamese Multi-scale Convolutional Networkscited by 9
- 2020Change Detection in Heterogeneous Optical and SAR Remote Sensing Images via Deep Homogeneous Feature Fusioncited by 9
- 2022Change Detection from Synthetic Aperture Radar Images via Graph-Based Knowledge Supplement Networkcited by 6
- 2020Adaptive Local Structure Consistency based Heterogeneous Remote Sensing Change Detectioncited by 4
- 2020An Investigation of Traffic Density Changes inside Wuhan during the COVID-19 Epidemic with GF-2 Time-Series Imagescited by 2
Built on by
Citing papers per year: 2023: 6; 2024: 4; 2025: 1; 2026: 1.
12 papers.
- 2024ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Modelcited by 118
- 2024Change Guiding Network: Incorporating Change Prior to Guide Change Detection in Remote Sensing Imagerycited by 30
- 2023Exchange means change: an unsupervised single-temporal change detection framework based on intra- and inter-image patch exchangecited by 20
- 2024Change Detection Between Optical Remote Sensing Imagery and Map Data via Segment Anything Model (SAM)cited by 12
- 2023ObjFormer: Learning Land-Cover Changes From Paired OSM Data and Optical High-Resolution Imagery via Object-Guided Transformercited by 8
- 2023T-UNet: Triplet UNet for Change Detection in High-Resolution Remote Sensing Imagescited by 4
- 2023Transformer-based Multimodal Change Detection with Multitask Consistency Constraintscited by 4
- 2023NN-Copula-CD: A Copula-Guided Interpretable Neural Network for Change Detection in Heterogeneous Remote Sensing Imagescited by 3
- 2023EMS-Net: Efficient Multi-Temporal Self-Attention For Hyperspectral Change Detectioncited by 2
- 2025S2C: Learning Noise-Resistant Differences for Unsupervised Change Detection in Multimodal Remote Sensing Imagescited by 2
- 2024Quantum Information-Empowered Graph Neural Network for Hyperspectral Change Detectioncited by 1
- 2026ChangeQuery: Advancing Remote Sensing Change Analysis for Natural and Human-Induced Disasters from Visual Detection to Semantic Understandingcited by 0
- 2026ChangeQuery: Advancing Remote Sensing Change Analysis for Natural and Human-Induced Disasters from Visual Detection to Semantic Understanding24 Apr 2026
- 2025S2C: Learning Noise-Resistant Differences for Unsupervised Change Detection in Multimodal Remote Sensing Images18 Feb 2025
- 2024Quantum Information-Empowered Graph Neural Network for Hyperspectral Change Detection12 Nov 2024
- 2024Change Guiding Network: Incorporating Change Prior to Guide Change Detection in Remote Sensing Imagery14 Apr 2024
- 2024ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Model4 Apr 2024
- 2024Change Detection Between Optical Remote Sensing Imagery and Map Data via Segment Anything Model (SAM)17 Jan 2024
- 2023Transformer-based Multimodal Change Detection with Multitask Consistency Constraints13 Oct 2023
- 2023ObjFormer: Learning Land-Cover Changes From Paired OSM Data and Optical High-Resolution Imagery via Object-Guided Transformer4 Oct 2023
- 2023Exchange means change: an unsupervised single-temporal change detection framework based on intra- and inter-image patch exchange1 Oct 2023
- 2023T-UNet: Triplet UNet for Change Detection in High-Resolution Remote Sensing Images4 Aug 2023
- 2023NN-Copula-CD: A Copula-Guided Interpretable Neural Network for Change Detection in Heterogeneous Remote Sensing Images30 Mar 2023
- 2023EMS-Net: Efficient Multi-Temporal Self-Attention For Hyperspectral Change Detection24 Mar 2023