mlsanityData to 7 Oct 2026

PhoenixSR: Generative Heterogeneous Distillation Unleashes Efficient Models for Real-World Super-Resolution

arXiv 2609.30988 ↗First posted 25 Sep 2026cs.CVcited by 0

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Real-world image super-resolution (SR) requires recovering perceptually realistic high-resolution images from complex low-resolution observations while preserving faithful content. Diffusion-based SR benefits from strong generative priors but incurs substantial computational overhead, whereas feed-forward CNN and Transformer SR models are efficient yet often struggle to recover realistic high-frequency details. This motivates a natural question: can diffusion priors be transferred to existing diffusion-free SR networks without introducing diffusion components at inference time? To this end, we propose PhoenixSR, a generative heterogeneous distillation framework that transfers diffusion priors to independently designed feed-forward SR networks through score-based distribution matching. Rather than aligning heterogeneous features or imitating sampled diffusion outputs, PhoenixSR uses the pretrained diffusion model as distribution-level supervision, while paired SR supervision preserves reconstruction fidelity. To make distribution matching effective for fidelity-sensitive SR, we introduce Heterogeneous Distribution Adaptation, which adapts the target score to the SR domain, improves tracking of the evolving student distribution, and anchors training with paired supervision. We further employ Directional Reliability Weighting, a lightweight residual-consistency-based reweighting strategy that reduces unstable distributional guidance. All diffusion-related components are removed after training, leaving the original student architecture and inference cost unchanged. Experiments on three SR benchmarks and six feed-forward backbones, including SwinIR, HAT, Real-ESRGAN, and SeeMoRe, show consistent perceptual improvements with largely preserved reconstruction fidelity.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. First posted on arXiv 25 Sep 2026.

Builds on

0 of 0 references.

No references here yet.

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2024One Step Diffusion-based Super-Resolution with Time-Aware Distillation
  2. 2026TEASR: Training-Efficient Any-Step Diffusion Transformer for Real-World Image Super-Resolution
  3. 2023Dissecting Arbitrary-scale Super-resolution Capability from Pre-trained Diffusion Generative Models
  4. 2024TSD-SR: One-Step Diffusion with Target Score Distillation for Real-World Image Super-Resolution
  5. 2025Towards Redundancy Reduction in Diffusion Models for Efficient Video Super-Resolution
  6. 2025One-Step Residual Shifting Diffusion for Image Super-Resolution via Distillation
  7. 2024You Only Need One Step: Fast Super-Resolution with Stable Diffusion via Scale Distillation
  8. 2025DiT4SR: Taming Diffusion Transformer for Real-World Image Super-Resolution