3DGS3: Joint Super Sampling and Frame Interpolation for Real-Time Large-Scale 3DGS Rendering
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) enables high-quality real-time 3D rendering but faces challenges in efficiently scaling to ultra-dense scenes and high-resolution due to computational bottlenecks that limit its use in latency-sensitive applications. Instead of optimizing the splatting pipeline itself, we propose 3DGS3, a unified post-rendering framework that jointly performs super sampling and frame interpolation through differentiable processing of low-resolution outputs to achieve both high-resolution and high-frame-rate rendering. Our Gradient- -Aware Super Sampling (GASS) module leverages the continuous differentiability of 3DGS to extract image gradients that guide a GRU-based refinement network to enable high-fidelity super sampling. Furthermore, a Lightweight Temporal Frame Interpolation (LTFI) module based on a compact U-Net-like backbone fuses temporal and differentiable spatial cues from consecutive frames to synthesize temporally coherent intermediate frames. Experiments on public datasets demonstrate that 3DGS3 achieves superior rendering efficiency and visual quality when compared with state-of-the-art methods and remains compatible with existing 3DGS acceleration techniques. The code will be publicly released upon acceptance.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 34 of its 60 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
34 of 60 references.
References · 34
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,016
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,678
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
- 2019Depth-Aware Video Frame Interpolationcited by 232
- 2017Video Frame Interpolation via Adaptive Separable Convolutioncited by 211
- 2017Video Frame Synthesis using Deep Voxel Flowcited by 209
- 2024Mini-Splatting: Representing Scenes with a Constrained Number of Gaussianscited by 208
- 2023EAGLES: Efficient Accelerated 3D Gaussians with Lightweight EncodingScited by 191
- 2024VR-GS: A Physical Dynamics-Aware Interactive Gaussian Splatting System in Virtual Realitycited by 175
22 more
- 2019AdaCoF: Adaptive Collaboration of Flows for Video Frame Interpolationcited by 133
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 110
- 2024RaDe-GS: Rasterizing Depth in Gaussian Splattingcited by 110
- 2022IFRNet: Intermediate Feature Refine Network for Efficient Frame Interpolationcited by 107
- 2020FLAVR: Flow-Agnostic Video Representations for Fast Frame Interpolationcited by 97
- 2024GES: Generalized Exponential Splatting for Efficient Radiance Field Renderingcited by 92
- 2024Speedy-Splat: Fast 3D Gaussian Splatting with Sparse Pixels and Sparse Primitivescited by 90
- 2024PUP 3D-GS: Principled Uncertainty Pruning for 3D Gaussian Splattingcited by 85
- 2024FlashGS: Efficient 3D Gaussian Splatting for Large-scale and High-resolution Renderingcited by 85
- 2021CDFI: Compression-Driven Network Design for Frame Interpolationcited by 55
- 2023Instant-3D: Instant Neural Radiance Field Training Towards On-Device AR/VR 3D Reconstructioncited by 49
- 2024UltraLight VM-UNet: Parallel Vision Mamba Significantly Reduces Parameters for Skin Lesion Segmentationcited by 45
- 2024AdR-Gaussian: Accelerating Gaussian Splatting with Adaptive Radiuscited by 34
- 2024VR-Splatting: Foveated Radiance Field Rendering via 3D Gaussian Splatting and Neural Pointscited by 29
- 2025Locality-aware Gaussian Compression for Fast and High-quality Renderingcited by 24
- 2024Deformable Radial Kernel Splattingcited by 17
- 2024Generalizable Implicit Motion Modeling for Video Frame Interpolationcited by 16
- 2024DisC-GS: Discontinuity-aware Gaussian Splattingcited by 11
- 2023FuseSR: Super Resolution for Real-time Rendering through Efficient Multi-resolution Fusioncited by 7
- 2025BG-Triangle: B'ezier Gaussian Triangle for 3D Vectorization and Renderingcited by 4
- 2023Neural Super-Resolution for Real-time Rendering with Radiance Demodulationcited by 3
- 2025Lightweight Gradient-Aware Upscaling of 3D Gaussian Splatting Imagescited by 1
Built on by
Not cited yet.