Small Clips, Big Gains: Learning Long-Range Refocused Temporal Information for Video Super-Resolution
Not on the map. Why?
Abstract (arXiv)
Video super-resolution (VSR) can achieve better performance compared to single image super-resolution by additionally leveraging temporal information. In particular, the recurrent-based VSR model exploits long-range temporal information during inference and achieves superior detail restoration. However, effectively learning these long-term dependencies within long videos remains a key challenge. To address this, we propose LRTI-VSR, a novel training framework for recurrent VSR that efficiently leverages Long-Range Refocused Temporal Information. Our framework includes a generic training strategy that utilizes temporal propagation features from long video clips while training on shorter video clips. Additionally, we introduce a refocused intra&inter-frame transformer block which allows the VSR model to selectively prioritize useful temporal information through its attention module while further improving inter-frame information utilization in the FFN module. We evaluate LRTI-VSR on both CNN and transformer-based VSR architectures, conducting extensive ablation studies to validate the contribution of each component. Experiments on long-video test sets demonstrate that LRTI-VSR achieves state-of-the-art performance while maintaining training and computational efficiency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 35 of its 44 references that are in the map. First posted on arXiv 4 May 2025.
Builds on
35 of 44 references.
References · 35
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2020Longformer: The Long-Document Transformercited by 3,413
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
- 2020Transformers are RNNs: Fast Autoregressive Transformers with Linear Attentioncited by 2,022
- 2019Generating Long Sequences with Sparse Transformerscited by 1,546
- 2017Deformable Convolutional Networkscited by 1,488
- 2016Real-Time Single Image and Video Super-Resolution Using an Efficient Sub-Pixel Convolutional Neural Networkcited by 1,204
- 2019Fast Transformer Decoding: One Write-Head is All You Needcited by 717
- 2017Video Enhancement with Task-Oriented Flowcited by 619
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
23 more
- 2018Generating Wikipedia by Summarizing Long Sequencescited by 335
- 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
- 2018TDAN: Temporally Deformable Alignment Network for Video Super-Resolutioncited by 226
- 2022VRT: A Video Restoration Transformercited by 220
- 2023LongNet: Scaling Transformers to 1,000,000,000 Tokenscited by 204
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 170
- 2018Frame-Recurrent Video Super-Resolutioncited by 160
- 2016Real-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensationcited by 156
- 2017Detail-revealing Deep Video Super-resolutioncited by 148
- 2021Investigating Tradeoffs in Real-World Video Super-Resolutioncited by 134
- 2021Sequence Parallelism: Long Sequence Training from System Perspectivecited by 126
- 2021Video Super-Resolution Transformercited by 121
- 2020Video Super-Resolution with Recurrent Structure-Detail Networkcited by 116
- 2020MuCAN: Multi-Correspondence Aggregation Network for Video Super-Resolutioncited by 89
- 2020Video Super-resolution with Temporal Group Attentioncited by 81
- 2022Rethinking Alignment in Video Super-Resolution Transformerscited by 71
- 2019Efficient Video Super-Resolution through Recurrent Latent Space Propagationcited by 69
- 2017Unbiased Online Recurrent Optimizationcited by 47
- 2024Video Super-Resolution Transformer with Masked Inter&Intra-Frame Attentioncited by 29
- 2022Learning Spatiotemporal Frequency-Transformer for Compressed Video Super-Resolutioncited by 25
- 2022Look Back and Forth: Video Super-Resolution with Explicit Temporal Difference Modelingcited by 20
- 2015Training recurrent networks online without backtrackingcited by 10
- 2021PGT: A Progressive Method for Training Models on Long Videoscited by 7
Built on by
Not cited yet.