mlsanityData to 14 Oct 2026

LinearSR: Unlocking Linear Attention for Stable and Efficient Image Super-Resolution

arXiv 2510.08771 ↗First posted 9 Oct 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Generative models for Image Super-Resolution (SR) are increasingly powerful, yet their reliance on self-attention's quadratic complexity (O(N^2)) creates a major computational bottleneck. Linear Attention offers an O(N) solution, but its promise for photorealistic SR has remained largely untapped, historically hindered by a cascade of interrelated and previously unsolved challenges. This paper introduces LinearSR, a holistic framework that, for the first time, systematically overcomes these critical hurdles. Specifically, we resolve a fundamental, training instability that causes catastrophic model divergence using our novel "knee point"-based Early-Stopping Guided Fine-tuning (ESGF) strategy. Furthermore, we mitigate the classic perception-distortion trade-off with a dedicated SNR-based Mixture of Experts (MoE) architecture. Finally, we establish an effective and lightweight guidance paradigm, TAG, derived from our "precision-over-volume" principle. Our resulting LinearSR model simultaneously delivers state-of-the-art perceptual quality with exceptional efficiency. Its core diffusion forward pass (1-NFE) achieves SOTA-level speed, while its overall multi-step inference time remains highly competitive. This work provides the first robust methodology for applying Linear Attention in the photorealistic SR domain, establishing a foundational paradigm for future research in efficient generative super-resolution.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 38 of its 46 references that are in the map. First posted on arXiv 9 Oct 2025.

Builds on

38 of 46 references.

References · 38

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  5. 2022Flow Matching for Generative Modelingcited by 5,702
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
  7. 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
  8. 2021SwinIR: Image Restoration Using Swin Transformercited by 1,887
  9. 2021Restormer: Efficient Transformer for High-Resolution Image Restorationcited by 1,627
  10. 2020Linformer: Self-Attention with Linear Complexitycited by 1,474
  11. 2016On Large-Batch Training for Deep Learning: Generalization Gap and Sharp Minimacited by 1,352
  12. 2018Image Super-Resolution Using Very Deep Residual Channel Attention Networkscited by 1,264
26 more
  1. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,224
  2. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
  3. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  4. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  5. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 931
  6. 2020Pre-Trained Image Processing Transformercited by 893
  7. 2023Improving and generalizing flow-based generative models with minibatch optimal transportcited by 879
  8. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 522
  9. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolutioncited by 489
  10. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
  11. 2016Accelerating the Super-Resolution Convolutional Neural Networkcited by 394
  12. 2018Efficient Attention: Attention with Linear Complexitiescited by 368
  13. 2024SANA: Efficient High-Resolution Image Synthesis with Linear Diffusion Transformerscited by 340
  14. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolutioncited by 315
  15. 2023Recognize Anything: A Strong Image Tagging Modelcited by 309
  16. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  17. 2020Component Divide-and-Conquer for Real-World Image Super-Resolutioncited by 246
  18. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolutioncited by 246
  19. 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Stepcited by 238
  20. 2024TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolutioncited by 87
  21. 2024Arbitrary-steps Image Super-resolution via Diffusion Inversioncited by 86
  22. 2024DreamClear: High-Capacity Real-World Image Restoration with Privacy-Safe Dataset Curationcited by 65
  23. 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolutioncited by 53
  24. 2022EfficientViT: Multi-Scale Linear Attention for High-Resolution Dense Predictioncited by 42
  25. 2023CAME: Confidence-guided Adaptive Memory Efficient Optimizationcited by 36
  26. 2025Exploring Scalable Unified Modeling for General Low-Level Visioncited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2023Dissecting Arbitrary-scale Super-resolution Capability from Pre-trained Diffusion Generative Models
  2. 2025Chain-of-Zoom: Extreme Super-Resolution via Scale Autoregression and Preference Alignment
  3. 2026VOSR: A Vision-Only Generative Model for Image Super-Resolution
  4. 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approach
  5. 2026Revisiting the Perception-Distortion Trade-off with Spatial-Semantic Guided Super-Resolution
  6. 2025CTSR: Controllable Fidelity-Realness Trade-off Distillation for Real-World Image Super Resolution
  7. 2025Perceive, Understand and Restore: Real-World Image Super-Resolution with Autoregressive Multimodal Generative Models
  8. 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors