mlsanityData to 14 Oct 2026

Towards Robust and Generalizable Continuous Space-Time Video Super-Resolution with Events

arXiv 2510.03833 ↗First posted 4 Oct 2025eess.IV cs.CV cs.MMcited by 1

Not on the map. Why?

Abstract (arXiv)

Continuous space-time video super-resolution (C-STVSR) has garnered increasing interest for its capability to reconstruct high-resolution and high-frame-rate videos at arbitrary spatial and temporal scales. However, prevailing methods often generalize poorly, producing unsatisfactory results when applied to out-of-distribution (OOD) scales. To overcome this limitation, we present EvEnhancer, a novel approach that marries the unique properties of high temporal resolution and high dynamic range encapsulated in event streams to achieve robust and generalizable C-STVSR. Our approach incorporates event-adapted synthesis that capitalizes on the spatiotemporal correlations between frames and events to capture long-term motion trajectories, enabling adaptive interpolation and fusion across space and time. This is then coupled with a local implicit video transformer that integrates local implicit video neural function with cross-scale spatiotemporal attention to learn continuous video representations and generate plausible videos at arbitrary resolutions and frame rates. We further develop EvEnhancerPlus, which builds a controllable switching mechanism that dynamically determines the reconstruction difficulty for each spatiotemporal pixel based on local event statistics. This allows the model to adaptively route reconstruction along the most suitable pathways at a fine-grained pixel level, substantially reducing computational overhead while maintaining excellent performance. Furthermore, we devise a cross-derivative training strategy that stabilizes the convergence of such a multi-pathway framework through staged cross-optimization. Extensive experiments demonstrate that our method achieves state-of-the-art performance on both synthetic and real-world datasets, while maintaining superior generalizability at OOD scales. The code is available at https://github.com/W-Shuoyan/EvEnhancerPlus.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 80 of its 107 references that are in the map. First posted on arXiv 4 Oct 2025.

Builds on

80 of 107 references.

References · 80

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2017Non-local Neural Networkscited by 2,293
  3. 2015FlowNet: Learning Optical Flow with Convolutional Networkscited by 1,059
  4. 2017PWC-Net: CNNs for Optical Flow Using Pyramid, Warping, and Cost Volumecited by 968
  5. 2016FlowNet 2.0: Evolution of Optical Flow Estimation with Deep Networkscited by 784
  6. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
  7. 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
  8. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
  9. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
  10. 2017Deep Laplacian Pyramid Networks for Fast and Accurate Super-Resolutioncited by 453
  11. 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
  12. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
38 more
  1. 2018Unsupervised Event-based Learning of Optical Flow, Depth, and Egomotioncited by 307
  2. 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
  3. 2020Softmax Splatting for Video Frame Interpolationcited by 279
  4. 2022Neighborhood Attention Transformercited by 239
  5. 2019Depth-Aware Video Frame Interpolationcited by 234
  6. 2018TDAN: Temporally Deformable Alignment Network for Video Super-Resolutioncited by 226
  7. 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 213
  8. 2020Real-Time Intermediate Flow Estimation for Video Frame Interpolationcited by 213
  9. 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 170
  10. 2019Video to Events: Recycling Video Datasets for Event Camerascited by 165
  11. 2017Video Frame Interpolation via Adaptive Convolutioncited by 158
  12. 2021TimeLens: Event-based Video Frame Interpolationcited by 151
  13. 2019Recurrent Back-Projection Network for Video Super-Resolutioncited by 148
  14. 2019Quadratic video interpolationcited by 145
  15. 2019AdaCoF: Adaptive Collaboration of Flows for Video Frame Interpolationcited by 134
  16. 2021Local Texture Estimator for Implicit Representation Functioncited by 127
  17. 2021Video Frame Interpolation Transformercited by 123
  18. 2022Time Lens++: Event-based Frame Interpolation with Parametric Non-linear Flow and Multi-scale Fusioncited by 111
  19. 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
  20. 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
  21. 2020FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolationcited by 98
  22. 2023Extracting Motion and Appearance via Inter-Frame Attention for Efficient Video Frame Interpolationcited by 98
  23. 2020Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolutioncited by 91
  24. 2020MuCAN: Multi-Correspondence Aggregation Network for Video Super-Resolutioncited by 89
  25. 2020Video Super-resolution with Temporal Group Attentioncited by 81
  26. 2022Learning Trajectory-Aware Transformer for Video Super-Resolutioncited by 61
  27. 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
  28. 2023Cascaded Local Implicit Transformer for Arbitrary-Scale Super-Resolutioncited by 52
  29. 2020Space-Time-Aware Multi-Resolution Video Enhancementcited by 49
  30. 2020Revisiting Temporal Modeling for Video Super-resolutioncited by 46
  31. 2021Implicit Transformer Network for Screen Content Image Continuous Super-Resolutioncited by 46
  32. 2019Unsupervised Video Interpolation Using Cycle Consistencycited by 44
  33. 2022RSTT: Real-time Spatial Temporal Transformer for Space-Time Video Super-Resolutioncited by 44
  34. 2020All at Once: Temporally Adaptive Multi-Frame Interpolation with Advanced Motion Modelingcited by 42
  35. 2022TimeReplayer: Unlocking the Potential of Event Cameras for Video Interpolationcited by 37
  36. 2019Fast Spatio-Temporal Residual Network for Video Super-Resolutioncited by 34
  37. 2023Learning Spatial-Temporal Implicit Neural Representations for Event-Guided Video Super-Resolutioncited by 33
  38. 2024Video Super-Resolution Transformer with Masked Inter&Intra-Frame Attentioncited by 29

50 most cited of 80 All 80 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.