TinySR: Pruning Diffusion for Real-World Image Super-Resolution
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Real-world image super-resolution (Real-ISR) focuses on recovering high-quality images from low-resolution inputs that suffer from complex degradations like noise, blur, and compression. Recently, diffusion models (DMs) have shown great potential in this area by leveraging strong generative priors to restore fine details. However, their iterative denoising process incurs high computational overhead, posing challenges for real-time applications. Although one-step distillation methods, such as OSEDiff and TSD-SR, offer faster inference, they remain fundamentally constrained by their large, over-parameterized model architectures. In this work, we present TinySR, a compact yet effective diffusion model specifically designed for Real-ISR that achieves real-time performance while maintaining perceptual quality. We introduce a Dynamic Inter-block Activation and an Expansion-Corrosion Strategy to facilitate more effective decision-making in depth pruning. We achieve VAE compression through channel pruning, attention removal and lightweight SepConv. We eliminate time- and prompt-related modules and perform pre-caching techniques to further speed up the model. TinySR significantly reduces computational cost and model size, achieving up to 5.68x speedup and 83% parameter reduction compared to its teacher TSD-SR, while still providing high quality results.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 44 of its 56 references that are in the map. First posted on arXiv 24 Aug 2025.
Builds on
44 of 56 references.
Closest ancestors · 8
Same direction, newest first
- 2024TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolution27 Nov
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolution12 Jun
- 2024AddSR: Accelerating Diffusion-based Blind Super-Resolution with Adversarial Diffusion Distillation2 Apr
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution27 Nov
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Step23 Nov
- 2023DiffBIR: Towards Blind Image Restoration with Generative Diffusion Prior29 Aug
- 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting23 Jul
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May
Other references · 36
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2016Categorical Reparameterization with Gumbel-Softmaxcited by 2,739
- 2016Xception: Deep Learning with Depthwise Separable Convolutionscited by 2,332
- 2015Learning both Weights and Connections for Efficient Neural Networkscited by 2,031
24 more
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 529
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
- 2024ShortGPT: Layers in Large Language Models are More Redundant Than You Expectcited by 383
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
- 2023Q-Diffusion: Quantizing Diffusion Modelscited by 273
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 246
- 2023SnapFusion: Text-to-Image Diffusion Model on Mobile Devices within Two Secondscited by 227
- 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 226
- 2023PTQD: Accurate Post-Training Quantization for Diffusion Modelscited by 170
- 2023Patch Diffusion: Faster and More Data-Efficient Training of Diffusion Modelscited by 133
- 2022Details or Artifacts: A Locally Discriminative Learning Approach to Realistic Image Super-Resolutioncited by 114
- 2022Real-World Blind Super-Resolution via Feature Matching with Implicit High-Resolution Priorscited by 100
- 2024DiM: Diffusion Mamba for Efficient High-Resolution Image Synthesiscited by 72
- 2024LD-Pruner: Efficient Pruning of Latent Diffusion Models using Task-Agnostic Insightscited by 65
- 2024Adversarial Diffusion Compression for Real-World Image Super-Resolutioncited by 52
- 2024TinyFusion: Diffusion Transformers Learned Shallowcited by 45
- 2024SnapGen: Taming High-Resolution Text-to-Image Models for Mobile Devices with Efficient Architectures and Trainingcited by 27
Built on by
Citing papers per year: 2025: 1; 2026: 6.
7 papers.
- 2025Pluggable Pruning with Contiguous Layer Distillation for Diffusion Transformerscited by 7
- 2026CoD-Lite: Real-Time Diffusion-Based Generative Image Compressioncited by 7
- 2026Improved Adversarial Diffusion Compression for Real-World Video Super-Resolutioncited by 5
- 2026NanoSD: Edge Efficient Foundation Model for Real Time Image Restorationcited by 2
- 2026OP4KSR: One-Step Patch-Free 4K Super-Resolution with Periodic Artifact Suppressioncited by 2
- 2026TRaM-VSR: Importance-Aware Token Routing and Merging for One-Step Diffusion Video Super-Resolutioncited by 1
- 2026TOC-SR: Task-Optimal Compact diffusion for Image Super Resolutioncited by 0
- 2026TRaM-VSR: Importance-Aware Token Routing and Merging for One-Step Diffusion Video Super-Resolution24 Jul 2026
- 2026OP4KSR: One-Step Patch-Free 4K Super-Resolution with Periodic Artifact Suppression13 May 2026
- 2026TOC-SR: Task-Optimal Compact diffusion for Image Super Resolution4 May 2026
- 2026CoD-Lite: Real-Time Diffusion-Based Generative Image Compression14 Apr 2026
- 2026Improved Adversarial Diffusion Compression for Real-World Video Super-Resolution28 Feb 2026
- 2026NanoSD: Edge Efficient Foundation Model for Real Time Image Restoration14 Jan 2026
- 2025Pluggable Pruning with Contiguous Layer Distillation for Diffusion Transformers20 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2026Degradation-Aware and Structure-Preserving Diffusion for Real-World Image Super-Resolution
- 2025PGP-DiffSR: Phase-Guided Progressive Pruning for Efficient Diffusion-based Image Super-Resolution
- 2026TEASR: Training-Efficient Any-Step Diffusion Transformer for Real-World Image Super-Resolution
- 2024Taming Diffusion Prior for Image Super-Resolution with Domain Shift SDEs
- 2026Bridging Restoration and Generation in One-step Diffusion for Real-World Image Super-Resolution
- 2026Efficient One-Step Diffusion Restoration Model with Compact Token Compression and Linear Attention
- 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolution
- 2023ACDMSR: Accelerated Conditional Diffusion Models for Single Image Super-Resolution