Learning to Balance: Decoupled Siamese Diffusion Transformer for Reference-Based Remote Sensing Image Super-Resolution
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Diffusion-based methods demonstrate significant potential for remote sensing image super-resolution at large scaling factors, particularly in reference-based super-resolution (RefSR), where high-resolution reference images provide critical fine-grained texture priors. However, existing methods often suffer from a trade-off between over-reliance on reference information, which leads to texture artifacts, and under-utilization of such information, which results in insufficient detail recovery. To address these issues, we propose DS-DiT, a Decoupled Siamese Diffusion Transformer that decouples the interaction between low-resolution (LR) and reference (Ref) conditions within the attention mechanism. By allowing LR structural priors and Ref texture information to independently interact with the noisy latent, the framework effectively mitigates competition between the two conditional sources. To further compensate for the limited local modeling ability of global attention, we introduce a Patch-Level Weighting (PLW) module that adaptively modulates the fusion of conditional sources. In addition, the siamese architecture enables an inference-time autoguidance strategy that exploits the prediction discrepancy between strong and weak Ref conditions to improve generation quality without additional training. Experimental results across multiple datasets and scaling factors show that DS-DiT outperforms existing methods in both quantitative metrics and visual fidelity.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 40 of its 53 references that are in the map. First posted on arXiv 18 May 2026.
Builds on
40 of 53 references.
Closest ancestors · 8
Same direction, newest first
- 2026Trust but Verify: Adaptive Conditioning for Reference-Based Diffusion Super-Resolution via Implicit Reference Correlation Modeling2 Feb
- 2025Task-Oriented Data Synthesis and Control-Rectify Sampling for Remote Sensing Semantic Segmentation18 Dec
- 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolution30 Mar
- 2024FaithDiff: Unleashing Diffusion Priors for Faithful Image Super-resolution27 Nov
- 2024Building Bridges across Spatial and Temporal Resolutions: Reference-Based Super-Resolution via Change Priors and Conditional Diffusion Model26 Mar
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution27 Nov
- 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization28 Aug
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May
Other references · 32
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 1,006
20 more
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2020Learning Texture Transformer Network for Image Super-Resolutioncited by 347
- 2024Guiding a Diffusion Model with a Bad Version of Itselfcited by 299
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
- 2019Image Super-Resolution by Neural Texture Transfercited by 120
- 2024Self-Rectifying Diffusion Sampling with Perturbed-Attention Guidancecited by 113
- 2018CrossNet: An End-to-end Reference-based Super Resolution Network using Cross-scale Warpingcited by 91
- 2021MASA-SR: Matching Acceleration and Spatial Adaptation for Reference-Based Image Super-Resolutioncited by 80
- 2021Robust Reference-based Super-Resolution via C2-Matchingcited by 69
- 2023CoSeR: Bridging Image and Language for Cognitive Super-Resolutioncited by 66
- 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 60
- 2024Smoothed Energy Guidance: Guiding Diffusion Models with Reduced Energy Curvature of Attentioncited by 59
- 2024No Training, No Problem: Rethinking Classifier-Free Guidance for Diffusion Modelscited by 53
- 2022Reference-based Image Super-Resolution with Deformable Attention Transformercited by 51
- 2020Semantic Change Detection with Asymmetric Siamese Networkscited by 31
- 2022Coarse-to-Fine Embedded PatchMatch and Multi-Scale Dynamic Aggregation for Reference-based Super-Resolutioncited by 19
- 2024ReFIR: Grounding Large Restoration Models with Retrieval Augmentationcited by 15
- 2024FUSU: A Multi-temporal-source Land Use Change Segmentation Dataset for Fine-grained Urban Semantic Understandingcited by 11
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026SlimDiffSR: Toward Lightweight and Efficient Remote Sensing Image Super-Resolution via Diffusion Model Distillation
- 2025Controllable Reference Guided Diffusion with Local Global Fusion for Real World Remote Sensing Image Super Resolution
- 2025TTRD3: Texture Transfer Residual Denoising Dual Diffusion Model for Remote Sensing Image Super-Resolution
- 2026Remote Sensing Image Super-Resolution for Imbalanced Textures: A Texture-Aware Diffusion Framework
- 2026InfScene-SR: Seamless Super-Resolution of Arbitrarily Large Remote-Sensing Scenes via Variance-Preserving Joint Denoising
- 2024Semantic Guided Large Scale Factor Remote Sensing Image Super-resolution with Generative Diffusion Prior
- 2024Latent Diffusion, Implicit Amplification: Efficient Continuous-Scale Super-Resolution for Remote Sensing Images
- 2025Single-Step Latent Consistency Model for Remote Sensing Image Super-Resolution