UltraVSR: Achieving Ultra-Realistic Video Super-Resolution with Efficient One-Step Diffusion Space
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Diffusion models have shown great potential in generating realistic image detail. However, adapting these models to video super-resolution (VSR) remains challenging due to their inherent stochasticity and lack of temporal modeling. Previous methods have attempted to mitigate this issue by incorporating motion information and temporal layers. However, unreliable motion estimation from low-resolution videos and costly multiple sampling steps with deep temporal layers limit them to short sequences. In this paper, we propose UltraVSR, a novel framework that enables ultra-realistic and temporally-coherent VSR through an efficient one-step diffusion space. A central component of UltraVSR is the Degradation-aware Reconstruction Scheduling (DRS), which estimates a degradation factor from the low-resolution input and transforms the iterative denoising process into a single-step reconstruction from low-resolution to high-resolution videos. To ensure temporal consistency, we propose a lightweight Recurrent Temporal Shift (RTS) module, including an RTS-convolution unit and an RTS-attention unit. By partially shifting feature components along the temporal dimension, it enables effective propagation, fusion, and alignment across frames without explicit temporal layers. The RTS module is integrated into a pretrained text-to-image diffusion model and is further enhanced through Spatio-temporal Joint Distillation (SJD), which improves temporally coherence while preserving realistic details. Additionally, we introduce a Temporally Asynchronous Inference (TAI) strategy to capture long-range temporal dependencies under limited memory constraints. Extensive experiments show that UltraVSR achieves state-of-the-art performance, both qualitatively and quantitatively, in a single sampling step. Code is available at https://github.com/yongliuy/UltraVSR.
Key facts. Cited by 14 papers in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 34 of its 59 references that are in the map. First posted on arXiv 26 May 2025.
Builds on
34 of 59 references.
Closest ancestors · 4
Same direction, newest first
- 2024Hero-SR: One-Step Diffusion for Super-Resolution with Human Perception Priors10 Dec
- 2024One-Step Effective Diffusion Network for Real-World Image Super-Resolution12 Jun
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Step23 Nov
- 2023ResShift: Efficient Diffusion Model for Image Super-resolution by Residual Shifting23 Jul
Other references · 30
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,025
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2023ProlificDreamer: High-Fidelity and Diverse Text-to-3D Generation with Variational Score Distillationcited by 1,219
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2021Real-ESRGAN: Training Real-World Blind Super-Resolution with Pure Synthetic Datacited by 970
- 2017The Perception-Distortion Tradeoffcited by 587
- 2022Paint by Example: Exemplar-based Image Editing with Diffusion Modelscited by 489
18 more
- 2023Emergent Correspondence from Image Diffusioncited by 446
- 2024One Step Diffusion via Shortcut Modelscited by 391
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
- 2024Scaling Up to Excellence: Practicing Model Scaling for Photo-Realistic Image Restoration In the Wildcited by 286
- 2024Motion-I2V: Consistent and Controllable Image-to-Video Generation with Explicit Motion Modelingcited by 211
- 2023ProPainter: Improving Propagation and Transformer for Video Inpaintingcited by 197
- 2020PIPAL: a Large-Scale Image Quality Assessment Dataset for Perceptual Image Restorationcited by 178
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 170
- 2017Detail-revealing Deep Video Super-resolutioncited by 148
- 2023Cross-Image Attention for Zero-Shot Appearance Transfercited by 136
- 2023SwiftBrush: One-Step Text-to-Image Diffusion Model with Variational Score Distillationcited by 110
- 2019Efficient Video Super-Resolution through Recurrent Latent Space Propagationcited by 69
- 2022A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shiftcited by 68
- 2021Omniscient Video Super-Resolutioncited by 30
- 2025Generative Models in Decision Making: A Surveycited by 15
- 2021Ada-VSR: Adaptive Video Super-Resolution with Meta-Learningcited by 3
Built on by
Citing papers per year: 2025: 6; 2026: 8.
14 papers.
Sort:
By area:
- 2025Single-step Diffusion-based Video Coding with Semantic-Temporal Guidancecited by 13
- 2025InfVSR: Toward Consistency-Driven Streaming Generative Video Super-Resolutioncited by 8
- 2025Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusioncited by 7
- 2026Improved Adversarial Diffusion Compression for Real-World Video Super-Resolutioncited by 5
- 2026DUO-VSR: Dual-Stream Distillation for One-Step Video Super-Resolutioncited by 4
- 2025Towards Redundancy Reduction in Diffusion Models for Efficient Video Super-Resolutioncited by 2
- 2025LVTINO: LAtent Video consisTency INverse sOlver for High Definition Video Restorationcited by 2
- 2025Trajectory-aware Shifted State Space Models for Online Video Super-Resolutioncited by 1
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusioncited by 1
- 2026TRaM-VSR: Importance-Aware Token Routing and Merging for One-Step Diffusion Video Super-Resolutioncited by 1
- 2026LiteVSR: Lightweight Adaptation of Frozen Diffusion Transformers for Video Super-Resolutioncited by 0
- 2026AnchorSplat: Fast and Structure Consistent Detail Synthesis for Gaussian Splattingcited by 0
- 2026SoL-Refiner: Speed-of-Light One-Step Refinement for High-Resolution Video29 Sep 2026
- 2026LoCoVSR: Local Context Diffusion Posterior Sampling for Video Super-Resolution26 Sep 2026
- 2026TRaM-VSR: Importance-Aware Token Routing and Merging for One-Step Diffusion Video Super-Resolution24 Jul 2026
- 2026AnchorSplat: Fast and Structure Consistent Detail Synthesis for Gaussian Splatting1 Jul 2026
- 2026LiteVSR: Lightweight Adaptation of Frozen Diffusion Transformers for Video Super-Resolution8 Jun 2026
- 2026DUO-VSR: Dual-Stream Distillation for One-Step Video Super-Resolution23 Mar 2026
- 2026Improved Adversarial Diffusion Compression for Real-World Video Super-Resolution28 Feb 2026
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusion28 Jan 2026
- 2025Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusion29 Dec 2025
- 2025Single-step Diffusion-based Video Coding with Semantic-Temporal Guidance8 Dec 2025
- 2025LVTINO: LAtent Video consisTency INverse sOlver for High Definition Video Restoration1 Oct 2025
- 2025InfVSR: Toward Consistency-Driven Streaming Generative Video Super-Resolution1 Oct 2025
- 2025Single-step Diffusion-based Video Coding with Semantic-Temporal Guidancecited by 13
- 2025Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusioncited by 7
- 2026Improved Adversarial Diffusion Compression for Real-World Video Super-Resolutioncited by 5
- 2026DUO-VSR: Dual-Stream Distillation for One-Step Video Super-Resolutioncited by 4
- 2025Towards Redundancy Reduction in Diffusion Models for Efficient Video Super-Resolutioncited by 2
- 2025LVTINO: LAtent Video consisTency INverse sOlver for High Definition Video Restorationcited by 2
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusioncited by 1
- 2026TRaM-VSR: Importance-Aware Token Routing and Merging for One-Step Diffusion Video Super-Resolutioncited by 1
- 2026LiteVSR: Lightweight Adaptation of Frozen Diffusion Transformers for Video Super-Resolutioncited by 0
- 2026TRaM-VSR: Importance-Aware Token Routing and Merging for One-Step Diffusion Video Super-Resolution24 Jul 2026
- 2026LiteVSR: Lightweight Adaptation of Frozen Diffusion Transformers for Video Super-Resolution8 Jun 2026
- 2026DUO-VSR: Dual-Stream Distillation for One-Step Video Super-Resolution23 Mar 2026
- 2026Improved Adversarial Diffusion Compression for Real-World Video Super-Resolution28 Feb 2026
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusion28 Jan 2026
- 2025Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusion29 Dec 2025
- 2025Single-step Diffusion-based Video Coding with Semantic-Temporal Guidance8 Dec 2025
- 2025LVTINO: LAtent Video consisTency INverse sOlver for High Definition Video Restoration1 Oct 2025
- 2025Towards Redundancy Reduction in Diffusion Models for Efficient Video Super-Resolution28 Sep 2025
- 2025InfVSR: Toward Consistency-Driven Streaming Generative Video Super-Resolutioncited by 8
- 2026AnchorSplat: Fast and Structure Consistent Detail Synthesis for Gaussian Splattingcited by 0
- 2026LoCoVSR: Local Context Diffusion Posterior Sampling for Video Super-Resolutioncited by 0
- 2026SoL-Refiner: Speed-of-Light One-Step Refinement for High-Resolution Videocited by 0
- 2026SoL-Refiner: Speed-of-Light One-Step Refinement for High-Resolution Video29 Sep 2026
- 2026LoCoVSR: Local Context Diffusion Posterior Sampling for Video Super-Resolution26 Sep 2026
- 2026AnchorSplat: Fast and Structure Consistent Detail Synthesis for Gaussian Splatting1 Jul 2026
- 2025InfVSR: Toward Consistency-Driven Streaming Generative Video Super-Resolution1 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolution
- 2023Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolution
- 2025DiffVSR: Revealing an Effective Recipe for Taming Robust Video Super-Resolution Against Complex Degradations
- 2025RealisVSR: Detail-enhanced Diffusion for Real-World 4K Video Super-Resolution
- 2026Streaming-Aware Diffusion for Real-Time Video Super-Resolution via Cross-Step Attention
- 2025DC-VSR: Spatially and Temporally Consistent Video Super-Resolution with Video Diffusion Prior
- 2025OS-DiffVSR: Towards One-step Latent Diffusion Model for High-detailed Real-world Video Super-Resolution
- 2025Spatial Degradation-Aware and Temporal Consistent Diffusion Model for Compressed Video Super-Resolution