LinearSR: Unlocking Linear Attention for Stable and Efficient Image Super-Resolution
Not on the map. Why?
Abstract (arXiv)
Generative models for Image Super-Resolution (SR) are increasingly powerful, yet their reliance on self-attention's quadratic complexity (O(N^2)) creates a major computational bottleneck. Linear Attention offers an O(N) solution, but its promise for photorealistic SR has remained largely untapped, historically hindered by a cascade of interrelated and previously unsolved challenges. This paper introduces LinearSR, a holistic framework that, for the first time, systematically overcomes these critical hurdles. Specifically, we resolve a fundamental, training instability that causes catastrophic model divergence using our novel "knee point"-based Early-Stopping Guided Fine-tuning (ESGF) strategy. Furthermore, we mitigate the classic perception-distortion trade-off with a dedicated SNR-based Mixture of Experts (MoE) architecture. Finally, we establish an effective and lightweight guidance paradigm, TAG, derived from our "precision-over-volume" principle. Our resulting LinearSR model simultaneously delivers state-of-the-art perceptual quality with exceptional efficiency. Its core diffusion forward pass (1-NFE) achieves SOTA-level speed, while its overall multi-step inference time remains highly competitive. This work provides the first robust methodology for applying Linear Attention in the photorealistic SR domain, establishing a foundational paradigm for future research in efficient generative super-resolution.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 46 references that are in the map. First posted on arXiv 9 Oct 2025.
Builds on
38 of 46 references.
References · 38
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
- 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
- 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
- 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,352
- 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
26 more
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
- 2020Pre-Trained Image Processing Transformercited by 893
- 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
- 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
- 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
- 2016Accelerating the Super-Resolution Convolutional Neural Networkcited by 394
- 2018Efficient Attention: Attention with Linear Complexitiescited by 368
- 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
- 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 315
- 2023Recognize Anything: A Strong Image Tagging Modelcited by 309
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
- 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 246
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 238
- 2024TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolutioncited by 87
- 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 86
- 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curationcited by 65
- 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolutioncited by 53
- 2022EfficientViT: Multi-Scale Linear Attention for High-Resolution Dense Predictioncited by 42
- 2023CAME: Confidence-guided Adaptive Memory Efficient Optimizationcited by 36
- 2025Exploring Scalable Unified Modeling for General Low-Level Visioncited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2023Dissecting Arbitrary-scale Super-resolution Capability from Pre-trained Diffusion Generative Models
- 2025Chain-of-Zoom: Extreme Super-Resolution via Scale Autoregression and Preference Alignment
- 2026VOSR: A Vision-Only Generative Model for Image Super-Resolution
- 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approach
- 2026Revisiting the Perception-Distortion Trade-off with Spatial-Semantic Guided Super-Resolution
- 2025CTSR: Controllable Fidelity-Realness Trade-off Distillation for Real-World Image Super Resolution
- 2025Perceive, Understand and Restore: Real-World Image Super-Resolution with Autoregressive Multimodal Generative Models
- 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors