mlsanityData to 14 Oct 2026

GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splatting

arXiv 2604.18047 ↗First posted 20 Apr 2026cs.CVcited by 1

Not on the map. Why?

Abstract (arXiv)

Continuous Spatio-Temporal Video Super-Resolution (C-STVSR) aims to simultaneously enhance the spatial resolution and frame rate of videos by arbitrary scale factors, offering greater flexibility than fixed-scale methods that are constrained by predefined upsampling ratios. In recent years, methods based on Implicit Neural Representations (INR) have made significant progress in C-STVSR by learning continuous mappings from spatio-temporal coordinates to pixel values. However, these methods fundamentally rely on dense pixel-wise grid queries, causing computational cost to scale linearly with the number of interpolated frames and severely limiting inference efficiency. We propose GS-STVSR, an ultra-efficient C-STVSR framework based on 2D Gaussian Splatting (2D-GS) that drives the spatiotemporal evolution of Gaussian kernels through continuous motion modeling, bypassing dense grid queries entirely. We exploit the strong temporal stability of covariance parameters for lightweight intermediate fitting, design an optical flow-guided motion module to derive Gaussian position and color at arbitrary time steps, introduce a Covariance resampling alignment module to prevent covariance drift, and propose an adaptive offset window for large-scale motion. Extensive experiments on Vid4, GoPro, and Adobe240 show that GS-STVSR achieves state-of-the-art quality across all benchmarks. Moreover, its inference time remains nearly constant at conventional temporal scales (X2--X8) and delivers over X3 speedup at extreme scales X32, demonstrating strong practical applicability.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 90 of its 141 references that are in the map. First posted on arXiv 20 Apr 2026.

Builds on

90 of 141 references.

References · 90

  1. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  2. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
  5. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
  6. 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
  7. 2018On the Spectral Bias of Neural Networkscited by 1,341
  8. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  9. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  10. 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
  11. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
  12. 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
38 more
  1. 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 424
  2. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  3. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 346
  4. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
  5. 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
  6. 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
  7. 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 307
  8. 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
  9. 2020Softmax Splatting for Video Frame Interpolationcited by 279
  10. 2019Depth-Aware Video Frame Interpolationcited by 234
  11. 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
  12. 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
  13. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
  14. 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 170
  15. 2018Frame-Recurrent Video Super-Resolutioncited by 160
  16. 2025HunyuanVideo 1.5 Technical Reportcited by 160
  17. 2016Real-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensationcited by 156
  18. 2022FILM: Frame Interpolation for Large Motioncited by 153
  19. 2019Quadratic video interpolationcited by 145
  20. 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
  21. 2021Local Texture Estimator for Implicit Representation Functioncited by 127
  22. 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advancescited by 110
  23. 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
  24. 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
  25. 2024GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splattingcited by 99
  26. 2024EraseAnything: Enabling Concept Erasure in Rectified Flow Transformerscited by 95
  27. 2023Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Groupingcited by 92
  28. 2020Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolutioncited by 91
  29. 2023Towards Unified Token Learning for Vision-Language Trackingcited by 62
  30. 2025Set You Straight: Auto-Steering Denoising Trajectories to Sidestep Unwanted Conceptscited by 62
  31. 2021Person Re-identification Method Based on Color Attack and Joint Defencecited by 56
  32. 2024Towards Realistic Data Generation for Real-World Super-Resolutioncited by 56
  33. 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
  34. 2020Space-Time-Aware Multi-Resolution Video Enhancementcited by 49
  35. 2025Pixel to Gaussian: Ultra-Fast Continuous Super-Resolution with 2D Gaussian Modelingcited by 48
  36. 2024Lightweight Adaptive Feature De-drifting for Compressed Image Classificationcited by 46
  37. 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editingcited by 46
  38. 2024SplineGS: Robust Motion-Adaptive Spline for Real-Time Dynamic 3D Gaussians from Monocular Videocited by 44

50 most cited of 90 All 90 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.