Video Super-Resolution with Recurrent Structure-Detail Network
Not on the map. Why?
Abstract (arXiv)
Most video super-resolution methods super-resolve a single reference frame with the help of neighboring frames in a temporal sliding window. They are less efficient compared to the recurrent-based methods. In this work, we propose a novel recurrent video super-resolution method which is both effective and efficient in exploiting previous frames to super-resolve the current frame. It divides the input into structure and detail components which are fed to a recurrent unit composed of several proposed two-stream structure-detail blocks. In addition, a hidden state adaptation module that allows the current frame to selectively use information from hidden state is introduced to enhance its robustness to appearance change and error accumulation. Extensive ablation study validate the effectiveness of the proposed modules. Experiments on several benchmark datasets demonstrate the superior performance of the proposed method compared to state-of-the-art methods on video super-resolution.
Key facts. Cited by 116 papers in the map (data through 7 Oct 2026). First posted on arXiv 2 Aug 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 38; 2023: 15; 2024: 12; 2025: 22; 2026: 5.
116 papers.
Sort:
By area:
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 340
- 2022VRT: A Video Restoration Transformercited by 219
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 168
- 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 133
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 131
- 2021Video Super-Resolution Transformercited by 120
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
- 2021Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescalingcited by 73
- 2022CiaoSR: Continuous Implicit Attention-in-Attention Network for Arbitrary-Scale Image Super-Resolutioncited by 69
- 2022A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shiftcited by 68
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
38 more
- 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restorationcited by 62
- 2022Learning Trajectory-Aware Transformer for Video Super-Resolutioncited by 61
- 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolutioncited by 56
- 2021Mutual Affine Network for Spatially Variant Kernel Estimation in Blind Image Super-Resolutioncited by 52
- 2021Multi-Target Domain Adaptation with Collaborative Consistency Learningcited by 43
- 2023Enhancing Video Super-Resolution via Implicit Resampling-based Alignmentcited by 35
- 2024DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Modelscited by 33
- 2024RealViformer: Investigating Attention for Real-World Video Super-Resolutioncited by 33
- 2021Dense Deep Unfolding Network with 3D-CNN Prior for Snapshot Compressive Imagingcited by 31
- 2021Omniscient Video Super-Resolutioncited by 30
- 2024VideoGigaGAN: Towards Detail-rich Video Super-Resolutioncited by 30
- 2024Video Super-Resolution Transformer with Masked Inter&Intra-Frame Attentioncited by 29
- 2021COMISR: Compression-Informed Video Super-Resolutioncited by 26
- 2022Learning Spatiotemporal Frequency-Transformer for Compressed Video Super-Resolutioncited by 25
- 2021Revisiting Temporal Alignment for Video Restorationcited by 24
- 2022Unidirectional Video Denoising by Mimicking Backward Recurrent Modules with Look-ahead Forward Onescited by 24
- 2022AnimeSR: Learning Real-World Super-Resolution Models for Animation Videoscited by 23
- 2024Learning Spatial Adaptation and Temporal Coherence in Diffusion Models for Video Super-Resolutioncited by 23
- 2022Enriched CNN-Transformer Feature Aggregation Networks for Super-Resolutioncited by 22
- 2022Basic Binary Convolution Unit for Binarized Image Restoration Networkcited by 22
- 2022Hitchhiker's Guide to Super-Resolution: Introduction and Recent Advancescited by 21
- 2023Can SAM Boost Video Super-Resolution?cited by 21
- 2022Look Back and Forth: Video Super-Resolution with Explicit Temporal Difference Modelingcited by 20
- 2022AIM 2022 Challenge on Super-Resolution of Compressed Image and Video: Dataset, Methods and Resultscited by 20
- 2022Benchmark Dataset and Effective Inter-Frame Alignment for Real-World Video Super-Resolutioncited by 20
- 2021FDAN: Flow-guided Deformable Alignment Network for Video Super-Resolutioncited by 19
- 2021Self-Conditioned Probabilistic Learning of Video Rescalingcited by 19
- 2022Reference-based Video Super-Resolution Using Multi-Camera Video Tripletscited by 19
- 2025PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancementcited by 17
- 2022Temporal Consistency Learning of inter-frames for Video Super-Resolutioncited by 16
- 2021NTIRE 2021 Challenge on Video Super-Resolutioncited by 15
- 2022Structured Sparsity Learning for Efficient Video Super-Resolutioncited by 14
- 2024Learning Truncated Causal History Model for Video Restorationcited by 13
- 2022Online Video Super-Resolution with Convolutional Kernel Bypass Graftcited by 12
- 2025Show and Polish: Reference-Guided Identity Preservation in Face Video Restorationcited by 12
- 2022Unsupervised Flow-Aligned Sequence-to-Sequence Learning for Video Restorationcited by 11
- 2021Efficient Space-time Video Super Resolution using Low-Resolution Flow and Mask Upsamplingcited by 9
- 2023A Dive into SAM Prior in Image Restorationcited by 9
50 most cited of 116 All 116 (JSON)
- 2026NanoVSR: Towards Real-Time Video Super-Resolution on Edge Devices11 Jul 2026
- 2026LiteVSR: Lightweight Adaptation of Frozen Diffusion Transformers for Video Super-Resolution8 Jun 2026
- 2026DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolution28 May 2026
- 2026DUO-VSR: Dual-Stream Distillation for One-Step Video Super-Resolution23 Mar 2026
- 2026HATIR: Heat-Aware Diffusion for Turbulent Infrared Video Super-Resolution8 Jan 2026
- 2025Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusion29 Dec 2025
- 2025Physics-Informed Video Flare Synthesis and Removal Leveraging Motion Independence between Flare and Scene12 Dec 2025
- 2025UniMMVSR: A Unified Multi-Modal Framework for Cascaded Video Super-Resolution9 Oct 2025
- 2025PatchVSR: Breaking Video Diffusion Resolution Limits with Patch-wise Video Super-Resolution30 Sep 2025
- 2025Towards Redundancy Reduction in Diffusion Models for Efficient Video Super-Resolution28 Sep 2025
- 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospects19 Sep 2025
- 2025Show and Polish: Reference-Guided Identity Preservation in Face Video Restoration14 Jul 2025
38 more
- 2025DAM-VSR: Disentanglement of Appearance and Motion for Video Super-Resolution1 Jul 2025
- 2025DicFace: Dirichlet-Constrained Variational Codebook Learning for Temporally Coherent Video Face Restoration16 Jun 2025
- 2025FCA2: Frame Compression-Aware Autoencoder for Modular and Fast Compressed Video Super-Resolution13 Jun 2025
- 2025LiftVSR: Lifting Image Diffusion to Video Super-Resolution via Hybrid Temporal Modeling with Only 4×RTX 4090s10 Jun 2025
- 2025Joint Video Enhancement with Deblurring, Super-Resolution, and Frame Interpolation Network4 Jun 2025
- 2025Omnidirectional Video Super-Resolution using Deep Learning3 Jun 2025
- 2025A Survey of Deep Learning Video Super-Resolution3 Jun 2025
- 2025Self-supervised ControlNet with Spatio-Temporal Mamba for Real-world Video Super-resolution1 Jun 2025
- 2025Burst Image Super-Resolution via Multi-Cross Attention Encoding and Multi-Scan State-Space Decoding26 May 2025
- 2025PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancement18 May 2025
- 2025Small Clips, Big Gains: Learning Long-Range Refocused Temporal Information for Video Super-Resolution4 May 2025
- 2025RepNet-VSR: Reparameterizable Architecture for High-Fidelity Video Super-Resolution22 Apr 2025
- 2025FCVSR: A Frequency-aware Method for Compressed Video Super-Resolution10 Feb 2025
- 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolution6 Jan 2025
- 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restoration2 Jan 2025
- 2024Learning Truncated Causal History Model for Video Restoration4 Oct 2024
- 2024Cascaded Temporal Updating Network for Efficient Video Super-Resolution26 Aug 2024
- 2024Adapting MIMO video restoration networks to low latency constraints22 Aug 2024
- 2024RealViformer: Investigating Attention for Real-World Video Super-Resolution19 Jul 2024
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generation10 Jul 2024
- 2024DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Models1 Jul 2024
- 2024VideoGigaGAN: Towards Detail-rich Video Super-Resolution18 Apr 2024
- 2024Collaborative Feedback Discriminative Propagation for Video Super-Resolution6 Apr 2024
- 2024Learning Spatial Adaptation and Temporal Coherence in Diffusion Models for Video Super-Resolution25 Mar 2024
- 2024Time-series Initialization and Conditioning for Video-agnostic Stabilization of Video Super-Resolution using Recurrent Networks23 Mar 2024
- 2024Decoupling Degradations with Recurrent Network for Video Restoration in Under-Display Camera8 Mar 2024
- 2024Video Super-Resolution Transformer with Masked Inter&Intra-Frame Attention12 Jan 2024
- 2023Toward Accurate and Temporally Consistent Video Restoration from Raw Data25 Dec 2023
- 2023TMP: Temporal Motion Propagation for Online Video Super-Resolution15 Dec 2023
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolution11 Dec 2023
- 2023An Operator Learning Framework for Spatiotemporal Super-resolution of Scientific Simulations4 Nov 2023
- 2023Efficient neural supersampling on a novel gaming dataset3 Aug 2023
- 2023RefVSR++: Exploiting Reference Inputs for Reference-based Video Super-resolution6 Jul 2023
- 2023Real-World Video for Zoom Enhancement based on Spatio-Temporal Coupling24 Jun 2023
- 2023EgoVSR: Towards High-Quality Egocentric Video Super-Resolution24 May 2023
- 2023A Dive into SAM Prior in Image Restoration23 May 2023
- 2023Can SAM Boost Video Super-Resolution?11 May 2023
- 2023SR+Codec: a Benchmark of Super-Resolution for Video Compression Bitrate Reduction8 May 2023
50 newest of 116 All 116 (JSON)
- 2023Upscale-A-Video: Temporal-Consistent Diffusion Model for Real-World Video Super-Resolutioncited by 131
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
- 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restorationcited by 62
- 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolutioncited by 56
- 2024DiffIR2VR-Zero: Zero-Shot Video Restoration with Diffusion-based Image Restoration Modelscited by 33
- 2024Learning Spatial Adaptation and Temporal Coherence in Diffusion Models for Video Super-Resolutioncited by 23
- 2025Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusioncited by 7
- 2025Self-supervised ControlNet with Spatio-Temporal Mamba for Real-world Video Super-resolutioncited by 5
- 2025DAM-VSR: Disentanglement of Appearance and Motion for Video Super-Resolutioncited by 5
- 2025LiftVSR: Lifting Image Diffusion to Video Super-Resolution via Hybrid Temporal Modeling with Only 4×RTX 4090scited by 4
- 2025PatchVSR: Breaking Video Diffusion Resolution Limits with Patch-wise Video Super-Resolutioncited by 4
- 2026DUO-VSR: Dual-Stream Distillation for One-Step Video Super-Resolutioncited by 4
12 most cited of 15 All 15 (JSON)
- 2026LiteVSR: Lightweight Adaptation of Frozen Diffusion Transformers for Video Super-Resolution8 Jun 2026
- 2026DTG-Restore: Training-Free Diffusion Refinement for Generative Video Super-Resolution28 May 2026
- 2026DUO-VSR: Dual-Stream Distillation for One-Step Video Super-Resolution23 Mar 2026
- 2025Stream-DiffVSR: Low-Latency Streamable Video Super-Resolution via Auto-Regressive Diffusion29 Dec 2025
- 2025PatchVSR: Breaking Video Diffusion Resolution Limits with Patch-wise Video Super-Resolution30 Sep 2025
- 2025Towards Redundancy Reduction in Diffusion Models for Efficient Video Super-Resolution28 Sep 2025
- 2025DAM-VSR: Disentanglement of Appearance and Motion for Video Super-Resolution1 Jul 2025
- 2025LiftVSR: Lifting Image Diffusion to Video Super-Resolution via Hybrid Temporal Modeling with Only 4×RTX 4090s10 Jun 2025
- 2025Self-supervised ControlNet with Spatio-Temporal Mamba for Real-world Video Super-resolution1 Jun 2025
- 2025STAR: Spatial-Temporal Augmentation with Text-to-Video Models for Real-World Video Super-Resolution6 Jan 2025
- 2025SeedVR: Seeding Infinity in Diffusion Transformer Towards Generic Video Restoration2 Jan 2025
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generation10 Jul 2024
12 newest of 15 All 15 (JSON)
- 2021SwinIR: Image Restoration Using Swin Transformercited by 1,869
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 340
- 2022VRT: A Video Restoration Transformercited by 219
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 168
- 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 133
- 2021Video Super-Resolution Transformercited by 120
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
- 2021Hierarchical Conditional Flow: A Unified Framework for Image Super-Resolution and Image Rescalingcited by 73
- 2022CiaoSR: Continuous Implicit Attention-in-Attention Network for Arbitrary-Scale Image Super-Resolutioncited by 69
- 2022A Simple Baseline for Video Restoration with Grouped Spatial-temporal Shiftcited by 68
- 2022Learning Trajectory-Aware Transformer for Video Super-Resolutioncited by 61
- 2021Mutual Affine Network for Spatially Variant Kernel Estimation in Blind Image Super-Resolutioncited by 52
12 most cited of 101 All 101 (JSON)
- 2026NanoVSR: Towards Real-Time Video Super-Resolution on Edge Devices11 Jul 2026
- 2026HATIR: Heat-Aware Diffusion for Turbulent Infrared Video Super-Resolution8 Jan 2026
- 2025Physics-Informed Video Flare Synthesis and Removal Leveraging Motion Independence between Flare and Scene12 Dec 2025
- 2025UniMMVSR: A Unified Multi-Modal Framework for Cascaded Video Super-Resolution9 Oct 2025
- 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospects19 Sep 2025
- 2025Show and Polish: Reference-Guided Identity Preservation in Face Video Restoration14 Jul 2025
- 2025DicFace: Dirichlet-Constrained Variational Codebook Learning for Temporally Coherent Video Face Restoration16 Jun 2025
- 2025FCA2: Frame Compression-Aware Autoencoder for Modular and Fast Compressed Video Super-Resolution13 Jun 2025
- 2025Joint Video Enhancement with Deblurring, Super-Resolution, and Frame Interpolation Network4 Jun 2025
- 2025Omnidirectional Video Super-Resolution using Deep Learning3 Jun 2025
- 2025A Survey of Deep Learning Video Super-Resolution3 Jun 2025
- 2025Burst Image Super-Resolution via Multi-Cross Attention Encoding and Multi-Scan State-Space Decoding26 May 2025
12 newest of 101 All 101 (JSON)