mlsanityData to 14 Oct 2026

UltraVSR: Achieving Ultra-Realistic Video Super-Resolution with Efficient One-Step Diffusion Space

arXiv 2505.19958 ↗First posted 26 May 2025cs.CVcited by 14

On the map: Diffusion models → Inverse problems and image restoration

Abstract (arXiv)

Diffusion models have shown great potential in generating realistic image detail. However, adapting these models to video super-resolution (VSR) remains challenging due to their inherent stochasticity and lack of temporal modeling. Previous methods have attempted to mitigate this issue by incorporating motion information and temporal layers. However, unreliable motion estimation from low-resolution videos and costly multiple sampling steps with deep temporal layers limit them to short sequences. In this paper, we propose UltraVSR, a novel framework that enables ultra-realistic and temporally-coherent VSR through an efficient one-step diffusion space. A central component of UltraVSR is the Degradation-aware Reconstruction Scheduling (DRS), which estimates a degradation factor from the low-resolution input and transforms the iterative denoising process into a single-step reconstruction from low-resolution to high-resolution videos. To ensure temporal consistency, we propose a lightweight Recurrent Temporal Shift (RTS) module, including an RTS-convolution unit and an RTS-attention unit. By partially shifting feature components along the temporal dimension, it enables effective propagation, fusion, and alignment across frames without explicit temporal layers. The RTS module is integrated into a pretrained text-to-image diffusion model and is further enhanced through Spatio-temporal Joint Distillation (SJD), which improves temporally coherence while preserving realistic details. Additionally, we introduce a Temporally Asynchronous Inference (TAI) strategy to capture long-range temporal dependencies under limited memory constraints. Extensive experiments show that UltraVSR achieves state-of-the-art performance, both qualitatively and quantitatively, in a single sampling step. Code is available at https://github.com/yongliuy/UltraVSR.

Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 34 of its 59 references that are in the map. First posted on arXiv 26 May 2025.

Builds on

34 of 59 references.

Closest ancestors · 4

Same direction, newest first

  1. 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors10 Dec
  2. 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolution12 Jun
  3. 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Step23 Nov
  4. 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting23 Jul

Other references · 30

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  4. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  5. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
  6. 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
  7. 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
  8. 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
  9. 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
  10. 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
  11. 2017The Perception-Distortion Tradeoffcited by 587
  12. 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
18 more
  1. 2023Emergent Correspondence from Image Diffusioncited by 446
  2. 2024One Step Diffusion via Shortcut Modelscited by 391
  3. 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
  4. 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
  5. 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
  6. 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
  7. 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
  8. 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
  9. 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 178
  10. 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 170
  11. 2017Detail-revealing Deep Video Super-resolutioncited by 148
  12. 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 136
  13. 2023SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillationcited by 110
  14. 2019Efficient Video Super-Resolution through Recurrent Latent Space Propagationcited by 69
  15. 2022A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shiftcited by 68
  16. 2021Omniscient Video Super-Resolutioncited by 30
  17. 2025Generative Models in Decision Making: A Surveycited by 15
  18. 2021Ada-VSR: Adaptive Video Super-Resolution with Meta-Learningcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 6; 2026: 8.

14 papers.

Sort:

By area:

Similar, not cited

Close in wording, no citation either way

  1. 2025FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolution
  2. 2023Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolution
  3. 2025DiffVSR: Revealing an Effective Recipe for Taming Robust Video Super-Resolution Against Complex Degradations
  4. 2025RealisVSR: Detail-enhanced Diffusion for Real-World 4K Video Super-Resolution
  5. 2026Streaming-Aware Diffusion for Real-Time Video Super-Resolution via Cross-Step Attention
  6. 2025DC-VSR: Spatially and Temporally Consistent Video Super-Resolution with Video Diffusion Prior
  7. 2025OS-DiffVSR: Towards One-step Latent Diffusion Model for High-detailed Real-world Video Super-Resolution
  8. 2025Spatial Degradation-Aware and Temporal Consistent Diffusion Model for Compressed Video Super-Resolution