Space-Time-Aware Multi-Resolution Video Enhancement
Not on the map. Why?
Abstract (arXiv)
We consider the problem of space-time super-resolution (ST-SR): increasing spatial resolution of video frames and simultaneously interpolating frames to increase the frame rate. Modern approaches handle these axes one at a time. In contrast, our proposed model called STARnet super-resolves jointly in space and time. This allows us to leverage mutually informative relationships between time and space: higher resolution can provide more detailed information about motion, and higher frame-rate can provide better pixel alignment. The components of our model that generate latent low- and high-resolution representations during ST-SR can be used to finetune a specialized mechanism for just spatial or just temporal super-resolution. Experimental results demonstrate that STARnet improves the performances of space-time, spatial, and temporal video super-resolution by substantial margins on publicly available datasets.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). First posted on arXiv 30 Mar 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 9; 2023: 8; 2024: 6; 2025: 9; 2026: 4.
48 papers.
Sort:
By area:
- 2022VRT: A Video Restoration Transformercited by 219
- 2021XVFI: eXtreme Video Frame Interpolationcited by 123
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
- 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
- 2023Video Event Restoration Based on Keyframes for Video Anomaly Detectioncited by 54
- 2022RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-Resolutioncited by 44
- 2021SRWarp: Generalized Image Super-Resolution under Arbitrary Transformationcited by 26
- 2021COMISR: Compression-Informed Video Super-Resolutioncited by 26
- 2021Learning for Unconstrained Space-Time Video Super-Resolutioncited by 18
- 2021DeMFI: Deep Joint Deblurring and Multi-Frame Interpolation with Flow-Guided Attentive Correlation and Recursive Boostingcited by 17
- 2025PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancementcited by 17
36 more
- 2021NTIRE 2021 Challenge on Video Super-Resolutioncited by 15
- 2022Spatial-Temporal Space Hand-in-Hand: Spatial-Temporal Video Super-Resolution via Cycle-Projected Mutual Learningcited by 12
- 2025NTIRE 2025 Challenge on UGC Video Enhancement: Methods and Resultscited by 12
- 2021Efficient Space-time Video Super Resolution using Low-Resolution Flow and Mask Upsamplingcited by 9
- 2025BF-STVSR: B-Splines and Fourier-Best Friends for High Fidelity Spatial-Temporal Video Super-Resolutioncited by 9
- 2021Optical Flow Reusing for High-Efficiency Space-Time Video Super Resolutioncited by 8
- 2021MEGAN: Memory Enhanced Graph Attention Network for Space-Time Video Super-Resolutioncited by 8
- 2023Video Frame Interpolation with Densely Queried Bilateral Correlationcited by 8
- 2023Scale-Adaptive Feature Aggregation for Efficient Space-Time Video Super-Resolutioncited by 8
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolationcited by 8
- 2023Joint Learning of Blind Super-Resolution and Crack Segmentation for Realistic Degraded Imagescited by 7
- 2022STDAN: Deformable Attention Network for Space-Time Video Super-Resolutioncited by 6
- 2023NTIRE 2023 Quality Assessment of Video Enhancement Challengecited by 6
- 2024HR-INR: Continuous Space-Time Video Super-Resolution via Event Cameracited by 6
- 2021Zooming SlowMo: An Efficient One-Stage Framework for Space-Time Video Super-Resolutioncited by 5
- 2023Video Dynamics Prior: An Internal Learning Approach for Robust Video Enhancementscited by 5
- 2021Learning-Based Video Coding with Joint Deep Compression and Enhancementcited by 4
- 2022You Only Align Once: Bidirectional Interaction for Spatial-Temporal Video Super-Resolutioncited by 3
- 2024Burst Super-Resolution with Diffusion Models for Improving Perceptual Qualitycited by 3
- 2024Space-Time Video Super-resolution with Neural Operatorcited by 3
- 2022Learning Spatio-Temporal Downsampling for Effective Video Upscalingcited by 2
- 2022Video Frame Interpolation with Transformercited by 2
- 2022Enhancing Space-time Video Super-resolution via Spatial-temporal Feature Interactioncited by 2
- 2025Efficient Burst Super-Resolution with One-step Diffusioncited by 2
- 2025MambaOVSR: Multiscale Fusion with Global Motion Modeling for Chinese Opera Video Super-Resolutioncited by 2
- 2024Global Spatial-Temporal Information-based Residual ConvLSTM for Video Space-Time Super-Resolutioncited by 1
- 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospectscited by 1
- 2025Towards Robust and Generalizable Continuous Space-Time Video Super-Resolution with Eventscited by 1
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusioncited by 1
- 2026PolarVSR: A Unified Framework and Benchmark for Continuous Space-Time Polarization Video Reconstructioncited by 1
- 2023Continuous Space-Time Video Super-Resolution Utilizing Long-Range Temporal Informationcited by 0
- 2023NNVISR: Bring Neural Network Video Interpolation and Super Resolution into Video Processing Frameworkcited by 0
- 2024Time-series Initialization and Conditioning for Video-agnostic Stabilization of Video Super-Resolution using Recurrent Networkscited by 0
- 2025Joint Video Enhancement with Deblurring, Super-Resolution, and Frame Interpolation Networkcited by 0
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splattingcited by 0
- 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolutioncited by 0
- 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolution13 May 2026
- 2026PolarVSR: A Unified Framework and Benchmark for Continuous Space-Time Polarization Video Reconstruction11 May 2026
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splatting20 Apr 2026
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusion28 Jan 2026
- 2025MambaOVSR: Multiscale Fusion with Global Motion Modeling for Chinese Opera Video Super-Resolution9 Nov 2025
- 2025Towards Robust and Generalizable Continuous Space-Time Video Super-Resolution with Events4 Oct 2025
- 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospects19 Sep 2025
- 2025Efficient Burst Super-Resolution with One-step Diffusion18 Jul 2025
- 2025Joint Video Enhancement with Deblurring, Super-Resolution, and Frame Interpolation Network4 Jun 2025
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
- 2025PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancement18 May 2025
- 2025NTIRE 2025 Challenge on UGC Video Enhancement: Methods and Results5 May 2025
36 more
- 2025BF-STVSR: B-Splines and Fourier-Best Friends for High Fidelity Spatial-Temporal Video Super-Resolution19 Jan 2025
- 2024Global Spatial-Temporal Information-based Residual ConvLSTM for Video Space-Time Super-Resolution11 Jul 2024
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generation10 Jul 2024
- 2024HR-INR: Continuous Space-Time Video Super-Resolution via Event Camera22 May 2024
- 2024Space-Time Video Super-resolution with Neural Operator9 Apr 2024
- 2024Burst Super-Resolution with Diffusion Models for Improving Perceptual Quality28 Mar 2024
- 2024Time-series Initialization and Conditioning for Video-agnostic Stabilization of Video Super-Resolution using Recurrent Networks23 Mar 2024
- 2023Video Dynamics Prior: An Internal Learning Approach for Robust Video Enhancements13 Dec 2023
- 2023Scale-Adaptive Feature Aggregation for Efficient Space-Time Video Super-Resolution26 Oct 2023
- 2023NNVISR: Bring Neural Network Video Interpolation and Super Resolution into Video Processing Framework6 Aug 2023
- 2023NTIRE 2023 Quality Assessment of Video Enhancement Challenge19 Jul 2023
- 2023Video Frame Interpolation with Densely Queried Bilateral Correlation26 Apr 2023
- 2023Video Event Restoration Based on Keyframes for Video Anomaly Detection11 Apr 2023
- 2023Continuous Space-Time Video Super-Resolution Utilizing Long-Range Temporal Information26 Feb 2023
- 2023Joint Learning of Blind Super-Resolution and Crack Segmentation for Realistic Degraded Images24 Feb 2023
- 2022Enhancing Space-time Video Super-resolution via Spatial-temporal Feature Interaction18 Jul 2022
- 2022You Only Align Once: Bidirectional Interaction for Spatial-Temporal Video Super-Resolution13 Jul 2022
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolution9 Jun 2022
- 2022Video Frame Interpolation with Transformer15 May 2022
- 2022Spatial-Temporal Space Hand-in-Hand: Spatial-Temporal Video Super-Resolution via Cycle-Projected Mutual Learning11 May 2022
- 2022RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-Resolution27 Mar 2022
- 2022Learning Spatio-Temporal Downsampling for Effective Video Upscaling15 Mar 2022
- 2022STDAN: Deformable Attention Network for Space-Time Video Super-Resolution14 Mar 2022
- 2022VRT: A Video Restoration Transformer28 Jan 2022
- 2021Learning-Based Video Coding with Joint Deep Compression and Enhancement29 Nov 2021
- 2021DeMFI: Deep Joint Deblurring and Multi-Frame Interpolation with Flow-Guided Attentive Correlation and Recursive Boosting19 Nov 2021
- 2021MEGAN: Memory Enhanced Graph Attention Network for Space-Time Video Super-Resolution28 Oct 2021
- 2021Optical Flow Reusing for High-Efficiency Space-Time Video Super Resolution13 Oct 2021
- 2021COMISR: Compression-Informed Video Super-Resolution4 May 2021
- 2021NTIRE 2021 Challenge on Video Super-Resolution30 Apr 2021
- 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolution21 Apr 2021
- 2021SRWarp: Generalized Image Super-Resolution under Arbitrary Transformation21 Apr 2021
- 2021Zooming SlowMo: An Efficient One-Stage Framework for Space-Time Video Super-Resolution15 Apr 2021
- 2021Efficient Space-time Video Super Resolution using Low-Resolution Flow and Mask Upsampling12 Apr 2021
- 2021XVFI: eXtreme Video Frame Interpolation30 Mar 2021
- 2021Learning for Unconstrained Space-Time Video Super-Resolution25 Feb 2021
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generationcited by 64
- 2024Burst Super-Resolution with Diffusion Models for Improving Perceptual Qualitycited by 3
- 2025Efficient Burst Super-Resolution with One-step Diffusioncited by 2
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusioncited by 1
- 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolutioncited by 0
- 2026DiffST: Spatiotemporal-Aware Diffusion for Real-World Space-Time Video Super-Resolution13 May 2026
- 2026Taming Real-World Space-Time Video Super-Resolution with One-Step Diffusion28 Jan 2026
- 2025Efficient Burst Super-Resolution with One-step Diffusion18 Jul 2025
- 2024VEnhancer: Generative Space-Time Enhancement for Video Generation10 Jul 2024
- 2024Burst Super-Resolution with Diffusion Models for Improving Perceptual Quality28 Mar 2024
- 2022VRT: A Video Restoration Transformercited by 219
- 2021XVFI: eXtreme Video Frame Interpolationcited by 123
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
- 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
- 2023Video Event Restoration Based on Keyframes for Video Anomaly Detectioncited by 54
- 2022RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-Resolutioncited by 44
- 2021SRWarp: Generalized Image Super-Resolution under Arbitrary Transformationcited by 26
- 2021COMISR: Compression-Informed Video Super-Resolutioncited by 26
- 2021Learning for Unconstrained Space-Time Video Super-Resolutioncited by 18
- 2021DeMFI: Deep Joint Deblurring and Multi-Frame Interpolation with Flow-Guided Attentive Correlation and Recursive Boostingcited by 17
- 2025PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancementcited by 17
- 2021NTIRE 2021 Challenge on Video Super-Resolutioncited by 15
12 most cited of 42 All 42 (JSON)
- 2026PolarVSR: A Unified Framework and Benchmark for Continuous Space-Time Polarization Video Reconstruction11 May 2026
- 2026GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splatting20 Apr 2026
- 2025Towards Robust and Generalizable Continuous Space-Time Video Super-Resolution with Events4 Oct 2025
- 2025Deep Learning Empowered Super-Resolution: A Comprehensive Survey and Future Prospects19 Sep 2025
- 2025Joint Video Enhancement with Deblurring, Super-Resolution, and Frame Interpolation Network4 Jun 2025
- 2025AceVFI: A Comprehensive Survey of Advances in Video Frame Interpolation1 Jun 2025
- 2025PMQ-VE: Progressive Multi-Frame Quantization for Video Enhancement18 May 2025
- 2025NTIRE 2025 Challenge on UGC Video Enhancement: Methods and Results5 May 2025
- 2025BF-STVSR: B-Splines and Fourier-Best Friends for High Fidelity Spatial-Temporal Video Super-Resolution19 Jan 2025
- 2024Global Spatial-Temporal Information-based Residual ConvLSTM for Video Space-Time Super-Resolution11 Jul 2024
- 2024HR-INR: Continuous Space-Time Video Super-Resolution via Event Camera22 May 2024
- 2024Space-Time Video Super-resolution with Neural Operator9 Apr 2024
12 newest of 42 All 42 (JSON)