GS-STVSR: Ultra-Efficient Continuous Spatio-Temporal Video Super-Resolution via 2D Gaussian Splatting
Not on the map. Why?
Abstract (arXiv)
Continuous Spatio-Temporal Video Super-Resolution (C-STVSR) aims to simultaneously enhance the spatial resolution and frame rate of videos by arbitrary scale factors, offering greater flexibility than fixed-scale methods that are constrained by predefined upsampling ratios. In recent years, methods based on Implicit Neural Representations (INR) have made significant progress in C-STVSR by learning continuous mappings from spatio-temporal coordinates to pixel values. However, these methods fundamentally rely on dense pixel-wise grid queries, causing computational cost to scale linearly with the number of interpolated frames and severely limiting inference efficiency. We propose GS-STVSR, an ultra-efficient C-STVSR framework based on 2D Gaussian Splatting (2D-GS) that drives the spatiotemporal evolution of Gaussian kernels through continuous motion modeling, bypassing dense grid queries entirely. We exploit the strong temporal stability of covariance parameters for lightweight intermediate fitting, design an optical flow-guided motion module to derive Gaussian position and color at arbitrary time steps, introduce a Covariance resampling alignment module to prevent covariance drift, and propose an adaptive offset window for large-scale motion. Extensive experiments on Vid4, GoPro, and Adobe240 show that GS-STVSR achieves state-of-the-art quality across all benchmarks. Moreover, its inference time remains nearly constant at conventional temporal scales (X2--X8) and delivers over X3 speedup at extreme scales X32, demonstrating strong practical applicability.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 90 of its 141 references that are in the map. First posted on arXiv 20 Apr 2026.
Builds on
90 of 141 references.
References · 90
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,415
- 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,238
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2018On the Spectral Bias of Neural Networkscited by 1,341
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2016Deep Multi-scale Convolutional Neural Network for Dynamic Scene Deblurringcited by 727
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 552
- 2019EDVR: Video Restoration with Enhanced Deformable Convolutional Networkscited by 494
38 more
- 2016Optical Flow Estimation using a Spatial Pyramid Networkcited by 424
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 346
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2021BasicVSR++: Improving Video Super-Resolution with Enhanced Propagation and Alignmentcited by 342
- 2017Super SloMo: High Quality Estimation of Multiple Intermediate Frames for Video Interpolationcited by 326
- 2024MACE: Mass Concept Erasure in Diffusion Modelscited by 307
- 2020BasicVSR: The Search for Essential Components in Video Super-Resolution and Beyondcited by 304
- 2020Softmax Splatting for Video Frame Interpolationcited by 279
- 2019Depth-Aware Video Frame Interpolationcited by 234
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
- 2023AMT: All-Pairs Multi-Field Transforms for Efficient Frame Interpolationcited by 180
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
- 2022Recurrent Video Restoration Transformer with Guided Deformable Attentioncited by 170
- 2018Frame-Recurrent Video Super-Resolutioncited by 160
- 2025HunyuanVideo 1.5 Technical Reportcited by 160
- 2016Real-Time Video Super-Resolution with Spatio-Temporal Networks and Motion Compensationcited by 156
- 2022FILM: Frame Interpolation for Large Motioncited by 153
- 2019Quadratic video interpolationcited by 145
- 2024ODTrack: Online Dense Temporal Token Learning for Visual Trackingcited by 129
- 2021Local Texture Estimator for Implicit Representation Functioncited by 127
- 2024Robust Watermarking Using Generative Priors Against Image Editing: From Benchmarking to Advancescited by 110
- 2021Asymmetric Bilateral Motion Estimation for Video Frame Interpolationcited by 101
- 2022VideoINR: Learning Video Implicit Neural Representation for Continuous Space-Time Super-Resolutioncited by 101
- 2024GaussianImage: 1000 FPS Image Representation and Compression by 2D Gaussian Splattingcited by 99
- 2024EraseAnything: Enabling Concept Erasure in Rectified Flow Transformerscited by 95
- 2023Weakly-Supervised Concealed Object Segmentation with SAM-based Pseudo Labeling and Multi-scale Feature Groupingcited by 92
- 2020Zooming Slow-Mo: Fast and Accurate One-Stage Space-Time Video Super-Resolutioncited by 91
- 2023Towards Unified Token Learning for Vision-Language Trackingcited by 62
- 2025Set You Straight: Auto-Steering Denoising Trajectories to Sidestep Unwanted Conceptscited by 62
- 2021Person Re-identification Method Based on Color Attack and Joint Defencecited by 56
- 2024Towards Realistic Data Generation for Real-World Super-Resolutioncited by 56
- 2021Temporal Modulation Network for Controllable Space-Time Video Super-Resolutioncited by 54
- 2020Space-Time-Aware Multi-Resolution Video Enhancementcited by 49
- 2025Pixel to Gaussian: Ultra-Fast Continuous Super-Resolution with 2D Gaussian Modelingcited by 48
- 2024Lightweight Adaptive Feature De-drifting for Compressed Image Classificationcited by 46
- 2025FLUX-Text: A Simple and Advanced Diffusion Transformer Baseline for Scene Text Editingcited by 46
- 2024SplineGS: Robust Motion-Adaptive Spline for Real-Time Dynamic 3D Gaussians from Monocular Videocited by 44
50 most cited of 90 All 90 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.