mlsanityData to 7 Oct 2026

A Decade of Deep Learning for Remote Sensing Spatiotemporal Fusion: Advances, Challenges, and Opportunities

arXiv 2504.00901 ↗First posted 1 Apr 2025cs.CVcited by 2

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Remote sensing spatiotemporal fusion (STF) addresses the fundamental trade-off between temporal and spatial resolution by combining high temporal-low spatial and high spatial-low temporal imagery. This paper presents the first comprehensive survey of deep learning advances in remote sensing STF over the past decade. We establish a systematic taxonomy of deep learning architectures including Convolutional Neural Networks (CNNs), Transformers, Generative Adversarial Networks (GANs), diffusion models, and sequence models, revealing significant growth in deep learning adoption for STF tasks. Our analysis reveals that CNN-based methods dominate spatial feature extraction, while Transformer architectures show superior performance in capturing long-range temporal dependencies. GAN and diffusion models demonstrate exceptional capability in detail reconstruction, substantially outperforming traditional methods in structural similarity and spectral fidelity. Through comprehensive experiments on seven benchmark datasets comparing ten representative methods, we validate these findings and quantify the performance trade-offs between different approaches. We identify five critical challenges: time-space conflicts, limited generalization across datasets, computational efficiency for large-scale processing, multi-source heterogeneous fusion, and insufficient benchmark diversity. The survey highlights promising opportunities in foundation models, hybrid architectures, and self-supervised learning approaches that could address current limitations and enable multimodal applications. The specific models, datasets, and other information mentioned in this article have been collected in: https://github.com/yc-cui/Deep-Learning-Spatiotemporal-Fusion-Survey.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 48 of its 221 references that are in the map. First posted on arXiv 1 Apr 2025.

Builds on

48 of 221 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Diffusion Models Meet Remote Sensing: Principles, Methods, and Perspectives13 Apr
  2. 2023DiffusionSat: A Generative Foundation Model for Satellite Imagery6 Dec

Other references · 46

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  6. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  7. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  8. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  9. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
  10. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  11. 2018CBAM: Convolutional Block Attention Modulecited by 2,463
  12. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
34 more
  1. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  2. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
  3. 2022Diffusion Models in Vision: A Surveycited by 1,008
  4. 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
  5. 2014Spatial Pyramid Pooling in Deep Convolutional Networks for Visual Recognitioncited by 719
  6. 2014Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFscited by 552
  7. 2018Fundamentals of Recurrent Neural Network (RNN) and Long Short-Term Memory (LSTM) Networkcited by 415
  8. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
  9. 2020A Survey of Convolutional Neural Networks: Analysis, Applications, and Prospectscited by 396
  10. 2016Convolutional Two-Stream Network Fusion for Video Action Recognitioncited by 384
  11. 2019SinGAN: Learning a Generative Model from a Single Natural Imagecited by 348
  12. 2020Point-GNN: Graph Neural Network for 3D Object Detection in a Point Cloudcited by 335
  13. 2019Learning Deep Transformer Models for Machine Translationcited by 309
  14. 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
  15. 2018The relativistic discriminator: a key element missing from standard GANcited by 234
  16. 2018Pros and Cons of GAN Evaluation Measurescited by 224
  17. 2019A Comparative Study on Transformer vs RNN in Speech Applicationscited by 210
  18. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 167
  19. 2018Independently Recurrent Neural Network (IndRNN): Building A Longer and Deeper RNNcited by 142
  20. 2017Deep learning in remote sensing: a reviewcited by 128
  21. 2020MetNet: A Neural Weather Model for Precipitation Forecastingcited by 128
  22. 2021An Introduction to Deep Generative Modelingcited by 104
  23. 2022Deep Learning in Multimodal Remote Sensing Data Fusion: A Comprehensive Reviewcited by 73
  24. 2018Spatial Fusion GAN for Image Synthesiscited by 68
  25. 2022Transformers in Remote Sensing: A Surveycited by 61
  26. 2017Evolving Deep Convolutional Neural Networks for Image Classificationcited by 54
  27. 2023Advancements in Generative AI: A Comprehensive Review of GANs, GPT, Autoencoders, Diffusion Model, and Transformerscited by 35
  28. 2022Spatial-Temporal Transformer for Video Snapshot Compressive Imagingcited by 21
  29. 2014On distinguishability criteria for estimating generative modelscited by 20
  30. 2020Code-Aligned Autoencoders for Unsupervised Change Detection in Multimodal Remote Sensing Imagescited by 17
  31. 2015Temporal-Difference Networkscited by 12
  32. 2021Coupling Model-Driven and Data-Driven Methods for Remote Sensing Image Restoration and Fusioncited by 11
  33. 2023OBSUM: An object-based spatial unmixing model for spatiotemporal fusion of remote sensing imagescited by 3
  34. 2023Resolution-Aware Design of Atrous Rates for Semantic Segmentation Networkscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025USF-Net: A Unified Spatiotemporal Fusion Network for Ground-Based Remote Sensing Cloud Image Sequence Extrapolation
  2. 2024FusionMamba: Efficient Remote Sensing Image Fusion with State Space Model
  3. 2025Leveraging Large-Scale Pretrained Spatial-Spectral Priors for General Zero-Shot Pansharpening
  4. 2025Can Generative Geospatial Diffusion Models Excel as Discriminative Geospatial Foundation Models?
  5. 2025Exploring the design space of diffusion and flow models for data fusion
  6. 2025Hierarchical Fusion of Local and Global Visual Features with Mixture-of-Experts for Remote Sensing Image Scene Classification
  7. 2025Balanced Diffusion-Guided Fusion for Multimodal Remote Sensing Classification
  8. 2025UniTS: Unified Spatio-Temporal Generative Model for Remote Sensing