SatFusion: A Unified Framework for Enhancing Remote Sensing Images via Multi-Frame and Multi-Source Images Fusion
Not on the map. Why?
Abstract (arXiv)
High-quality remote sensing (RS) image acquisition is fundamentally constrained by physical limitations. While Multi-Frame Super-Resolution (MFSR) and Pansharpening address this by exploiting complementary information, they are typically studied in isolation: MFSR lacks high-resolution (HR) structural priors for fine-grained texture recovery, whereas Pansharpening relies on upsampled low-resolution (LR) inputs and is sensitive to noise and misalignment. In this paper, we propose SatFusion, a novel and unified framework that seamlessly bridges multi-frame and multi-source RS image fusion. SatFusion extracts HR semantic features by aggregating complementary information from multiple LR multispectral frames via a Multi-Frame Image Fusion (MFIF) module, and integrates fine-grained structural details from an HR panchromatic image through a Multi-Source Image Fusion (MSIF) module with implicit pixel-level alignment. To further alleviate the lack of structural priors during multi-frame fusion, we introduce an advanced variant, SatFusion*, which integrates a panchromatic-guided mechanism into the MFIF stage. Through structure-aware feature embedding and transformer-based adaptive aggregation, SatFusion* enables spatially adaptive feature selection, strengthening the coupling between multi-frame and multi-source representations. Extensive experiments on four benchmark datasets validate our core insight: synergistically coupling multi-frame and multi-source priors effectively resolves the fragility of existing paradigms, delivering superior reconstruction fidelity, robustness, and generalizability.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 33 of its 61 references that are in the map. First posted on arXiv 9 Oct 2025.
Builds on
33 of 61 references.
References · 33
- 2017Attention Is All You Needcited by 59,932
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 4,993
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,310
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,199
- 2021Deep Burst Super-Resolutioncited by 83
- 2024Pan-Mamba: Effective pan-sharpening with State Space Modelcited by 73
- 2015Hyperspectral pansharpening: a reviewcited by 55
- 2017A Multi-Scale and Multi-Depth Convolutional Neural Network for Remote Sensing Imagery Pan-Sharpeningcited by 54
21 more
- 2020HighRes-net: Recursive Fusion for Multi-Frame Super-Resolution of Satellite Imagerycited by 42
- 2022Open High-Resolution Satellite Imagery: The WorldStrat Dataset -- With Application to Super-Resolutioncited by 40
- 2019DeepSUM: Deep neural network for Super-resolution of Unregistered Multitemporal imagescited by 30
- 2018Pansharpening via Detail Injection Based Convolutional Neural Networkscited by 29
- 2024QMambaBSR: Burst Image Super-Resolution with Query State Space Modelcited by 27
- 2017Boosting the accuracy of multi-spectral image pan-sharpening by learning a deep residual networkcited by 23
- 2022AI Security for Geoscience and Remote Sensing: Challenges and Future Trendscited by 23
- 2020Multi-image Super Resolution of Remotely Sensed Images using Residual Feature Attention Deep Neural Networkscited by 22
- 2020The Final Frontier: Deep Learning in Spacecited by 21
- 2024Content-Adaptive Non-Local Convolution for Remote Sensing Pansharpeningcited by 20
- 2021Multi-Spectral Multi-Image Super-Resolution of Sentinel-2 with Radiometric Consistency Losses and Its Effect on Building Delineationcited by 19
- 2022U2Net: A General Framework with Spatial-Spectral-Integrated Double U-Net for Image Fusioncited by 19
- 2024SSDiff: Spatial-spectral Integrated Diffusion Model for Remote Sensing Pansharpeningcited by 15
- 2023Towards Real-World Burst Image Super-Resolution: Benchmark and Methodcited by 12
- 2025Adaptive Rectangular Convolution for Remote Sensing Pansharpeningcited by 10
- 2020Accelerating Deep Learning Applications in Spacecited by 9
- 2024C-DiffSET: Leveraging Latent Diffusion for SAR-to-EO Image Translation with Confidence-Guided Reliable Object Generationcited by 8
- 2025A General Adaptive Dual-level Weighting Mechanism for Remote Sensing Pansharpeningcited by 8
- 2024U-Know-DiffPAN: An Uncertainty-aware Knowledge Distillation Diffusion Framework with Details Enhancement for PAN-Sharpeningcited by 5
- 2023Probability-based Global Cross-modal Upsampling for Pansharpeningcited by 4
- 2025PAN-Crafter: Learning Modality-Consistent Alignment for PAN-Sharpeningcited by 3
Built on by
Not cited yet.