mlsanityData to 7 Oct 2026

SPARK: Input-Conditioned Sparse Activation Modulation for Frozen DiT-based Super-Resolution

arXiv 2609.03813 ↗First posted 3 Sep 2026cs.CVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Real-world image super-resolution (SR) increasingly relies on Diffusion Transformer (DiT) backbones, whose internal activations can be dominated by a small number of massive channels. Yet improving perceptual quality in these models still typically requires fine-tuning the network or attaching additional adapters, leaving this structured activation space largely unexplored for adaptation. We investigate whether dominant channels can instead serve as a compact adaptation interface for frozen DiT-based SR models. We first characterize their behavior in pretrained SR backbones and show through controlled interventions that they strongly affect reconstruction quality. Building on this observation, we introduce SPARK, a lightweight input-conditioned controller that predicts bounded per-channel affine transformations for only the selected channels, while keeping the SR backbone and VAE frozen. Dominant channels are identified through an online activation-ranking procedure, and only a small predictor conditioned on the low-resolution VAE latent is optimized. Experiments on three DiT-based SR backbones across DIV2K, RealSR, and DRealSR show consistent gains in both fidelity and perceptual quality while modulating only eight channels per stream and block. Controlled comparisons further show that these gains cannot be explained by parameter budget or access to the selected channels alone.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 53 of its 60 references that are in the map. First posted on arXiv 3 Sep 2026.

Builds on

53 of 60 references.

Closest ancestors · 15

Same direction, newest first

  1. 2026TEASR: Training-Efficient Any-Step Diffusion Transformer for Real-World Image Super-Resolution15 Jun
  2. 2025Fine-structure Preserved Real-world Image Super-resolution via Transfer VAE Training27 Jul
  3. 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolution30 Mar
  4. 2025One Diffusion Step to Real-World Super-Resolution via Flow Trajectory Distillation4 Feb
  5. 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approach4 Dec
  6. 2024TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolution27 Nov
  7. 2024Effective Diffusion Transformer Architecture for Image Super-Resolution29 Sep
  8. 2024Degradation-Guided One-Step Image Super-Resolution with Diffusion Priors25 Sep
  9. 2024One Step Diffusion-based Super-Resolution with Time-Aware Distillation14 Aug
  10. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolution12 Jun
  11. 2024AddSR: Accelerating Diffusion-based Blind Super-Resolution with Adversarial Diffusion Distillation2 Apr
  12. 2023SeeSR: Towards Semantics-Aware Real-World Image Super-Resolution27 Nov
3 more
  1. 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Step23 Nov
  2. 2023Pixel-Aware Stable Diffusion for Realistic Image Super-resolution and Personalized Stylization28 Aug
  3. 2023Exploiting Diffusion Prior for Real-World Image Super-Resolution11 May

Other references · 38

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  3. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  4. 2022Scalable Diffusion Models with Transformerscited by 5,931
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  8. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
  9. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  10. 2017Enhanced Deep Residual Networks for Single Image Super-Resolutioncited by 1,543
  11. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  12. 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
26 more
  1. 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,058
  2. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 974
  3. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 961
  4. 2025FLUX.1 Kontext: Flow Matching for In-Context Image Generation and Editing in Latent Spacecited by 960
  5. 2022Few-Shot Parameter-Efficient Fine-Tuning is Better and Cheaper than In-Context Learningcited by 886
  6. 2023Vision Transformers Need Registerscited by 844
  7. 2017The Perception-Distortion Tradeoffcited by 582
  8. 2021Designing a Practical Degradation Model for Deep Blind Image Super-Resolutioncited by 524
  9. 2022MANIQA: Multi-dimension Attention Network for No-Reference Image Quality Assessmentcited by 514
  10. 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 400
  11. 2024Flow Matching Guide and Codecited by 291
  12. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 281
  13. 2024Massive Activations in Large Language Modelscited by 277
  14. 2023Blind Image Quality Assessment via Vision-Language Correspondence: A Multitask Learning Perspectivecited by 276
  15. 2023TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessmentcited by 220
  16. 2024ReFT: Representation Finetuning for Language Modelscited by 186
  17. 2024ViDiT-Q: Efficient and Accurate Quantization of Diffusion Transformers for Image and Video Generationcited by 110
  18. 2024TinyFusion: Diffusion Transformers Learned Shallowcited by 44
  19. 2024Denoising Vision Transformerscited by 40
  20. 2024Unveiling Linguistic Regions in Large Language Modelscited by 22
  21. 2025Unleashing Diffusion Transformers for Visual Correspondence by Modulating Massive Activationscited by 20
  22. 2025PocketSR: The Super-Resolution Expert in Your Pocket Mobilescited by 8
  23. 2025Massive Activations are the Key to Local Detail Synthesis in Diffusion Transformerscited by 7
  24. 2026Diffusion Language Models: An Experimental Analysiscited by 2
  25. 2026GramSR: Visual Feature Conditioning for Diffusion-Based Super-Resolutioncited by 1
  26. 2026Few Channels Draw The Whole Picture: Revealing Massive Activations in Diffusion Transformerscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026LiteVSR: Lightweight Adaptation of Frozen Diffusion Transformers for Video Super-Resolution
  2. 2026When Latents Forget Pixels: Restoring Fidelity in Diffusion Transformer Super-Resolution
  3. 2026PhoenixSR: Generative Heterogeneous Distillation Unleashes Efficient Models for Real-World Super-Resolution
  4. 2026TOC-SR: Task-Optimal Compact diffusion for Image Super Resolution
  5. 2025GuideSR: Rethinking Guidance for One-Step High-Fidelity Diffusion-Based Super-Resolution
  6. 2023Dissecting Arbitrary-scale Super-resolution Capability from Pre-trained Diffusion Generative Models
  7. 2026DreamSR: Towards Ultra-High-Resolution Image Super-Resolution via a Receptive-Field Enhanced Diffusion Transformer
  8. 2025One-Step Residual Shifting Diffusion for Image Super-Resolution via Distillation