Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusion
On the map: Diffusion models → Inverse problems and image restoration
Abstract (arXiv)
Diffusion models have demonstrated exceptional success in video super-resolution (VSR), exhibiting powerful capabilities for generating fine-grained details. However, their potential for space-time video super-resolution (STVSR), which necessitates not only recovering realistic high-resolution visual content but also improving the frame rate with coherent temporal dynamics, remains largely underexplored. Moreover, existing STVSR methods predominantly address spatiotemporal upsampling under simple degradation assumptions, thus failing in real-world scenarios with complex unknown degradations. To address these challenges, we propose OSDEnhancer, the first framework that achieves robust STVSR in one-step diffusion. OSDEnhancer begins with a linear initialization to establish essential spatiotemporal structures and adapt the model for one-step reconstruction. It then applies a divide-and-conquer strategy, introducing the temporal coherence (TC) and texture enrichment (TE) LoRAs that progressively specialize in inter-frame dynamics modeling and fine-grained texture recovery, respectively, while collaborating during inference for enhanced overall performance. A bidirectional VAE decoder employs deformable recurrent blocks to leverage the multi-scale structure of the vanilla VAE, enhancing latent-to-pixel reconstruction through joint multi-scale deformable aggregation and inter-frame feature propagation. Experimental results demonstrate that the proposed method attains state-of-the-art performance with superior generalization in real-world scenarios. The code is available at https://github.com/W-Shuoyan/OSDEnhancer.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Inverse problems and image restoration, one of 14 directions in Diffusion models. Builds on 67 of its 83 references that are in the map. First posted on arXiv 28 Jan 2026.
Builds on
67 of 83 references.
Closest ancestors · 12
Same direction, newest first
- 2025FlashVSR: Towards Real-Time Diffusion-Based Streaming Video Super-Resolution14 Oct
- 2025DAM-VSR: Disentanglement of Appearance and Motion for Video Super-Resolution1 Jul
- 2025One-Step Diffusion for Detail-Rich and Temporally Consistent Video Super-Resolution18 Jun
- 2025SeedVR2: One-Step Video Restoration via Diffusion Adversarial Post-Training5 Jun
- 2025Self-supervised ControlNet with Spatio-Temporal Mamba for Real-world Video Super-resolution1 Jun
- 2025UltraVSR: Achieving Ultra-Realistic Video Super-Resolution with Efficient One-Step Diffusion Space26 May
- 2025DOVE: Efficient One-Step Diffusion Model for Real-World Video Super-Resolution22 May
- 2025DC-VSR: Spatially and Temporally Consistent Video Super-Resolution with Video Diffusion Prior5 Feb
- 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolution6 Jan
- 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restoration2 Jan
- 2024Pixel-level and Semantic-level Adjustable Super-resolution: A Dual-LoRA Approach4 Dec
- 2023SinSR: Diffusion-Based Image Super-Resolution in a Single Step23 Nov
Other references · 55
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2022Video Diffusion Modelscited by 2,305
- 2024CogVideoX: Text-to-Video Diffusion Models with An Expert Transformercited by 2,261
- 2017Decoupled Weight Decay Regularizationcited by 1,831
- 2021MUSIQ: Multi-scale Image Quality Transformercited by 1,081
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2022Exploring CLIP for Assessing the Look and Feel of Imagescited by 991
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
38 more
- 2020Image Quality Assessment: Unifying Structure and Texture Similaritycited by 811
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
- 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
- 2019Toward Real-World Single Image Super-Resolution: A New Benchmark and A New Modelcited by 403
- 2023InstaFlow: One Step is Enough for High-Quality Diffusion-Based Text-to-Image Generationcited by 395
- 2023I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Modelscited by 350
- 2022Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectivescited by 320
- 2018Learning Blind Video Temporal Consistencycited by 253
- 2019Depth-Aware Video Frame Interpolationcited by 234
- 2018TDAN: Temporally Deformable Alignment Network for Video Super-Resolutioncited by 226
- 2025Diffusion Adversarial Post-Training for One-Step Video Generationcited by 151
- 2017Detail-revealing Deep Video Super-resolutioncited by 148
- 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 134
- 2017Occlusion Aware Unsupervised Learning of Optical Flowcited by 101
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
- 2020Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolutioncited by 91
- 2023LDMVFI: Video Frame Interpolation with Latent Diffusion Modelscited by 89
- 2024Video Interpolation with Diffusion Modelscited by 68
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
- 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
- 2022Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessmentcited by 50
- 2020Space-Time-Aware Multi-Resolution Video Enhancementcited by 49
- 2022RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-Resolutioncited by 44
- 2022FloLPIPS: A Bespoke Video Quality Metric for Frame Interpoationcited by 37
- 2024RealViformer: Investigating Attention for Real-World Video Super-Resolutioncited by 33
- 2024VideoGigaGAN: Towards Detail-rich Video Super-Resolutioncited by 30
- 2019FISR: Deep Joint Frame Interpolation and Super-Resolution with a Multi-scale Temporal Losscited by 28
- 2024Generative Inbetweening through Frame-wise Conditions-Driven Video Generationcited by 24
- 2022Benchmark Dataset and Effective Inter-Frame Alignment for Real-World Video Super-Resolutioncited by 20
- 2021Self-Conditioned Probabilistic Learning of Video Rescalingcited by 19
- 2025EDEN: Enhanced Diffusion for High-quality Large-motion Video Frame Interpolationcited by 19
- 2023MoTIF: Learning Motion Trajectories with Local Implicit Neural Functions for Continuous Space-Time Video Super-Resolutioncited by 16
- 2024BiM-VFI: Bidirectional Motion Field-Guided Frame Interpolation for Video with Non-uniform Motionscited by 13
- 2022Spatial-Temporal Space Hand-in-Hand: Spatial-Temporal Video Super-Resolution via Cycle-Projected Mutual Learningcited by 12
- 2025BF-STVSR: B-Splines and Fourier-Best Friends for High Fidelity Spatial-Temporal Video Super-Resolutioncited by 9
- 2021Optical Flow Reusing for High-Efficiency Space-Time Video Super Resolutioncited by 8
- 2023Scale-Adaptive Feature Aggregation for Efficient Space-Time Video Super-Resolutioncited by 8
50 most cited of 55 All 55 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolution
- 2025RealisVSR: Detail-enhanced Diffusion for Real-World 4K Video Super-Resolution
- 2025Spatial Degradation-Aware and Temporal Consistent Diffusion Model for Compressed Video Super-Resolution
- 2025STCDiT: Spatio-Temporally Consistent Diffusion Transformer for High-Quality Video Super-Resolution
- 2025OS-DiffVSR: Towards One-step Latent Diffusion Model for High-detailed Real-world Video Super-Resolution
- 2025Rethinking Video Super-Resolution: Towards Diffusion-Based Methods without Motion Alignment
- 2023Motion-Guided Latent Diffusion for Temporally Consistent Real-world Video Super-resolution
- 2024Learning Spatial Adaptation and Temporal Coherence in Diffusion Models for Video Super-Resolution