Motion Matters: Compact Gaussian Streaming for Free-Viewpoint Video Reconstruction
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has emerged as a high-fidelity and efficient paradigm for online free-viewpoint video (FVV) reconstruction, offering viewers rapid responsiveness and immersive experiences. However, existing online methods face challenge in prohibitive storage requirements primarily due to point-wise modeling that fails to exploit the motion properties. To address this limitation, we propose a novel Compact Gaussian Streaming (ComGS) framework, leveraging the locality and consistency of motion in dynamic scene, that models object-consistent Gaussian point motion through keypoint-driven motion representation. By transmitting only the keypoint attributes, this framework provides a more storage-efficient solution. Specifically, we first identify a sparse set of motion-sensitive keypoints localized within motion regions using a viewspace gradient difference strategy. Equipped with these keypoints, we propose an adaptive motion-driven mechanism that predicts a spatial influence field for propagating keypoint motion to neighboring Gaussian points with similar motion. Moreover, ComGS adopts an error-aware correction strategy for key frame reconstruction that selectively refines erroneous regions and mitigates error accumulation without unnecessary overhead. Overall, ComGS achieves a remarkable storage reduction of over 159 X compared to 3DGStream and 14 X compared to the SOTA method QUEEN, while maintaining competitive visual fidelity and rendering speed.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 21 of its 29 references that are in the map. First posted on arXiv 22 May 2025.
Builds on
21 of 29 references.
References · 21
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,280
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2021Direct Voxel Grid Optimization: Super-fast Convergence for Radiance Fields Reconstructioncited by 964
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 436
- 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 372
- 2023Compressed 3D Gaussian Splatting for Accelerated Novel View Synthesiscited by 239
- 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 209
9 more
- 2022Streaming Radiance Fields for 3D Video Synthesiscited by 119
- 2024End-to-End Rate-Distortion Optimized 3D Gaussian Representationcited by 75
- 2024Representing Long Volumetric Video with Temporal Gaussian Hierarchycited by 58
- 2025CAT-3DGS: A Context-Adaptive Triplane Approach to Rate-Distortion-Optimized 3DGS Compressioncited by 41
- 20244D Gaussian Splatting with Scale-aware Residual Field and Adaptive Optimization for Real-time Rendering of Temporally Complex Dynamic Scenescited by 37
- 2025Instant Gaussian Stream: Fast and Generalizable Streaming of Dynamic Scene Reconstruction via Gaussian Splattingcited by 36
- 2024V^3: Viewing Volumetric Videos on Mobiles via Streamable 2D Dynamic Gaussianscited by 29
- 20244D Scaffold Gaussian Splatting with Dynamic-Aware Anchor Growing for Efficient and High-Fidelity Dynamic Scene Reconstructioncited by 11
- 2025SDD-4DGS: Static-Dynamic Aware Decoupling in Gaussian Splatting for 4D Scene Reconstructioncited by 3
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026HPC: Hierarchical Point-based Latent Representation for Streaming Dynamic Gaussian Splatting Compressioncited by 0
- 2026DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streamingcited by 0
- 2026QuARC-GS: Quantized Anchored Residual Coding for Compact Dynamic Scene Streaming with Gaussian Splattingcited by 0
- 2026S2GS: Structured Sparse Gaussian Streaming for Efficient Free-Viewpoint Video Reconstruction on Edge-IoT Devicescited by 0
- 2026DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streamingcited by 0
- 2026DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streaming15 Sep 2026
- 2026S2GS: Structured Sparse Gaussian Streaming for Efficient Free-Viewpoint Video Reconstruction on Edge-IoT Devices20 Aug 2026
- 2026QuARC-GS: Quantized Anchored Residual Coding for Compact Dynamic Scene Streaming with Gaussian Splatting18 Aug 2026
- 2026DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming27 Jun 2026
- 2026HPC: Hierarchical Point-based Latent Representation for Streaming Dynamic Gaussian Splatting Compression31 Jan 2026