FRAMER: Frequency-Aligned Self-Distillation with Adaptive Modulation Leveraging Diffusion Priors for Real-World Image Super-Resolution
On the map: Diffusion models → Inverse problems and image restoration
also in 1 more
Abstract (arXiv)
Real-image super-resolution (Real-ISR) seeks to recover HR images from LR inputs with mixed, unknown degradations. While diffusion models surpass GANs in perceptual quality, they under-reconstruct high-frequency (HF) details due to a low-frequency (LF) bias and a depth-wise "low-first, high-later" hierarchy. We introduce FRAMER, a plug-and-play training scheme that exploits diffusion priors without changing the backbone or inference. At each denoising step, the final-layer feature map teaches all intermediate layers. Teacher and student feature maps are decomposed into LF/HF bands via FFT masks to align supervision with the model's internal frequency hierarchy. For LF, an Intra Contrastive Loss (IntraCL) stabilizes globally shared structure. For HF, an Inter Contrastive Loss (InterCL) sharpens instance-specific details using random-layer and in-batch negatives. Two adaptive modulators, Frequency-based Adaptive Weight (FAW) and Frequency-based Alignment Modulation (FAM), reweight per-layer LF/HF signals and gate distillation by current similarity. Across U-Net and DiT backbones (e.g., Stable Diffusion 2, 3), FRAMER consistently improves PSNR/SSIM and perceptual metrics (LPIPS, NIQE, MANIQA, MUSIQ). Ablations validate the final-layer teacher and random-layer negatives.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 35 of its 48 references that are in the map. First posted on arXiv 1 Dec 2025.
Builds on
35 of 48 references.
Closest ancestors · 8
Same direction, newest first
- 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolution30 Mar
- 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approach4 Dec
- 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curation24 Oct
- 2024ControlSR: Taming Diffusion Models for Consistent Real-World Image Super Resolution18 Oct
- 2024Effective Diffusion Transformer Architecture for Image Super-Resolution29 Sep
- 2024Frequency-Domain Refinement with Multiscale Diffusion for Super Resolution16 May
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution27 Nov
- 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting23 Jul
Other references · 27
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015Distilling the Knowledge in a Neural Networkcited by 10,324
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2014FitNets: Hints for Thin Deep Netscited by 1,653
- 2021Image Super-Resolution via Iterative Refinementcited by 1,511
15 more
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2019Be Your Own Teacher: Improve the Performance of Convolutional Neural Networks via Self Distillationcited by 497
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
- 2022Decoupled Knowledge Distillationcited by 388
- 2022Perception Prioritized Training of Diffusion Modelscited by 303
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 246
- 2024FouriScale: A Frequency Perspective on Training-Free High-Resolution Image Synthesiscited by 59
- 2025No Other Representation Component Is Needed: Diffusion Transformers Can Provide Representation Guidance by Themselvescited by 56
- 2025A Fourier Space Perspective on Diffusion Modelscited by 52
- 2024Boosting Latent Diffusion with Perceptual Objectivescited by 20
- 2021Self-Distilled Self-Supervised Representation Learningcited by 14
- 2025Shaping Inductive Bias in Diffusion Models through Frequency-Based Noise Controlcited by 11
- 2025Decoupling High and Low Frequencies for Faithful Image Generation with Fine Detailscited by 7
- 2024Does Diffusion Beat GAN in Image Super Resolution?cited by 3
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2024AddSR: Accelerating Diffusion-based Blind Super-Resolution with Adversarial Diffusion Distillation
- 2026Noise-Started One-Step Real-World Super-Resolution via LR-Conditioned SplitMeanFlow and GAN Refinement
- 2024One Step Diffusion-based Super-Resolution with Time-Aware Distillation
- 2024Adversarial Diffusion Compression for Real-World Image Super-Resolution
- 2026DNF-SR: Dual-Input and Negative-Aware Feature Fine-Tuning for Real-World Image Super-Resolution
- 2025AdaptSR: Low-Rank Adaptation for Efficient and Scalable Real-World Super-Resolution
- 2023Denoising Diffusion Probabilistic Models for Robust Image Super-Resolution in the Wild
- 2026TEASR: Training-Efficient Any-Step Diffusion Transformer for Real-World Image Super-Resolution