4DGC: Rate-Aware 4D Gaussian Compression for Efficient Streamable Free-Viewpoint Video
Not on the map. Why?
Abstract (arXiv)
3D Gaussian Splatting (3DGS) has substantial potential for enabling photorealistic Free-Viewpoint Video (FVV) experiences. However, the vast number of Gaussians and their associated attributes poses significant challenges for storage and transmission. Existing methods typically handle dynamic 3DGS representation and compression separately, neglecting motion information and the rate-distortion (RD) trade-off during training, leading to performance degradation and increased model redundancy. To address this gap, we propose 4DGC, a novel rate-aware 4D Gaussian compression framework that significantly reduces storage size while maintaining superior RD performance for FVV. Specifically, 4DGC introduces a motion-aware dynamic Gaussian representation that utilizes a compact motion grid combined with sparse compensated Gaussians to exploit inter-frame similarities. This representation effectively handles large motions, preserving quality and reducing temporal redundancy. Furthermore, we present an end-to-end compression scheme that employs differentiable quantization and a tiny implicit entropy model to compress the motion grid and compensated Gaussians efficiently. The entire framework is jointly optimized using a rate-distortion trade-off. Extensive experiments demonstrate that 4DGC supports variable bitrates and consistently outperforms existing methods in RD performance across multiple datasets.
Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 62 of its 77 references that are in the map. First posted on arXiv 24 Mar 2025.
Builds on
62 of 77 references.
References · 62
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
- 2018Variational image compression with a scale hyperpriorcited by 910
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
38 more
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
- 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
- 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
- 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
- 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 324
- 2020CompressAI: a PyTorch library and evaluation platform for end-to-end compression researchcited by 271
- 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 215
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
- 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
- 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 156
- 2017Soft-to-Hard Vector Quantization for End-to-End Learning Compressible Representationscited by 149
- 2023CompGS: Smaller and Faster Gaussian Splatting with Vector Quantizationcited by 127
- 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 126
- 2022Streaming Radiance Fields for 3D Video Synthesiscited by 118
- 2021Temporal Context Mining for Learned Video Compressioncited by 112
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 2024ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Modelcited by 98
- 2024FlashGS: Efficient 3D Gaussian Splatting for Large-scale and High-resolution Renderingcited by 85
- 2023Neural Residual Radiance Fields for Streamably Free-Viewpoint Videoscited by 77
- 2017Learning Convolutional Networks for Content-weighted Image Compressioncited by 73
- 2016End-to-end optimization of nonlinear transform codes for perceptual qualitycited by 72
- 2023HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splattingcited by 68
- 2023DBARF: Deep Bundle-Adjusting Generalizable Neural Radiance Fieldscited by 60
- 2023Temporal Interpolation Is All You Need for Dynamic Neural Radiance Fieldscited by 59
- 2022Masked Wavelet Representation for Compact Neural Radiance Fieldscited by 57
- 2023CamP: Camera Preconditioning for Neural Radiance Fieldscited by 55
- 2023Representing Volumetric Videos as Dynamic MLP Mapscited by 51
50 most cited of 62 All 62 (JSON)
Built on by
Citing papers per year: 2025: 8; 2026: 18.
26 papers.
Sort:
- 2025ReCon-GS: Continuum-Preserved Gaussian Streaming for Fast and Compact Reconstruction of Dynamic Scenescited by 12
- 20254DGCPro: Efficient Hierarchical 4D Gaussian Compression for Progressive Volumetric Video Streamingcited by 11
- 2025MAPo : Motion-Aware Partitioning of Deformable 3D Gaussian Splatting for High-Fidelity Dynamic Scene Reconstructioncited by 3
- 2026ClipGStream: Clip-Stream Gaussian Splatting for Any Length and Any Motion Multi-View Dynamic Scene Reconstructioncited by 3
- 2025Semantics versus Identity: A Divide-and-Conquer Approach towards Adjustable Medical Image De-Identificationcited by 2
- 20254D-MoDe: Towards Editable and Scalable Volumetric Streaming via Motion-Decoupled 4D Gaussian Compressioncited by 2
- 2026LoD-Structured 3D Gaussian Splatting for Streaming Video Reconstructioncited by 2
- 2026MoRGS: Efficient Per-Gaussian Motion Reasoning for Streamable Dynamic 3D Scenescited by 2
- 2025PrismGS: Physically-Grounded Anti-Aliasing for High-Fidelity Large-Scale 3D Gaussian Splattingcited by 1
- 2025AlignGS: Aligning Geometry and Semantics for Robust Indoor Reconstruction from Sparse Viewscited by 1
- 2026GenSplatCodec: Feed-Forward Gaussian Splatting Compression via One-Step Diffusioncited by 1
- 2025Do Flat Minima Improve Sparse Novel View Synthesis?cited by 0
14 more
- 2026Lightweight High-Fidelity Low-Bitrate Talking Face Compression for 3D Video Conferencecited by 0
- 2026HPC: Hierarchical Point-based Latent Representation for Streaming Dynamic Gaussian Splatting Compressioncited by 0
- 2026Constrained Dynamic Gaussian Splattingcited by 0
- 2026Fast and Robust Deformable 3D Gaussian Splattingcited by 0
- 2026GeoRect4D: Geometry-Compatible Generative Rectification for Dynamic Sparse-View 3D Reconstructioncited by 0
- 20264D Reconstruction from Sparse Dynamic Camerascited by 0
- 2026DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streamingcited by 0
- 2026S2GS: Structured Sparse Gaussian Streaming for Efficient Free-Viewpoint Video Reconstruction on Edge-IoT Devicescited by 0
- 2026CC-4DGS: Computational Deformation and Point-Cloud Compression for Storage-Efficient Dynamic Gaussian Splattingcited by 0
- 2026DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streamingcited by 0
- 2026Robust, Estimator-Agnostic Dynamic 3DGS Compressioncited by 0
- 2026ADATEX4D: adaptive texture capacity allocation for 4D gaussian splattingcited by 0
- 2026Gaussian Splatting-based Volumetric Video Compression with Sparse 4D Anchorscited by 0
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstructioncited by 0
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026Gaussian Splatting-based Volumetric Video Compression with Sparse 4D Anchors27 Sep 2026
- 2026ADATEX4D: adaptive texture capacity allocation for 4D gaussian splatting24 Sep 2026
- 2026Robust, Estimator-Agnostic Dynamic 3DGS Compression22 Sep 2026
- 2026DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streaming15 Sep 2026
- 2026CC-4DGS: Computational Deformation and Point-Cloud Compression for Storage-Efficient Dynamic Gaussian Splatting2 Sep 2026
- 2026S2GS: Structured Sparse Gaussian Streaming for Efficient Free-Viewpoint Video Reconstruction on Edge-IoT Devices20 Aug 2026
- 2026GenSplatCodec: Feed-Forward Gaussian Splatting Compression via One-Step Diffusion27 Jul 2026
- 2026DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming27 Jun 2026
- 20264D Reconstruction from Sparse Dynamic Cameras3 Jun 2026
- 2026GeoRect4D: Geometry-Compatible Generative Rectification for Dynamic Sparse-View 3D Reconstruction22 Apr 2026
- 2026ClipGStream: Clip-Stream Gaussian Splatting for Any Length and Any Motion Multi-View Dynamic Scene Reconstruction15 Apr 2026
14 more
- 2026MoRGS: Efficient Per-Gaussian Motion Reasoning for Streamable Dynamic 3D Scenes26 Mar 2026
- 2026Fast and Robust Deformable 3D Gaussian Splatting21 Mar 2026
- 2026Constrained Dynamic Gaussian Splatting3 Feb 2026
- 2026HPC: Hierarchical Point-based Latent Representation for Streaming Dynamic Gaussian Splatting Compression31 Jan 2026
- 2026Lightweight High-Fidelity Low-Bitrate Talking Face Compression for 3D Video Conference29 Jan 2026
- 2026LoD-Structured 3D Gaussian Splatting for Streaming Video Reconstruction26 Jan 2026
- 2025Do Flat Minima Improve Sparse Novel View Synthesis?22 Nov 2025
- 2025AlignGS: Aligning Geometry and Semantics for Robust Indoor Reconstruction from Sparse Views9 Oct 2025
- 2025PrismGS: Physically-Grounded Anti-Aliasing for High-Fidelity Large-Scale 3D Gaussian Splatting9 Oct 2025
- 2025ReCon-GS: Continuum-Preserved Gaussian Streaming for Fast and Compact Reconstruction of Dynamic Scenes29 Sep 2025
- 20254DGCPro: Efficient Hierarchical 4D Gaussian Compression for Progressive Volumetric Video Streaming22 Sep 2025
- 20254D-MoDe: Towards Editable and Scalable Volumetric Streaming via Motion-Decoupled 4D Gaussian Compression22 Sep 2025
- 2025MAPo : Motion-Aware Partitioning of Deformable 3D Gaussian Splatting for High-Fidelity Dynamic Scene Reconstruction27 Aug 2025
- 2025Semantics versus Identity: A Divide-and-Conquer Approach towards Adjustable Medical Image De-Identification25 Jul 2025
- 2025ReCon-GS: Continuum-Preserved Gaussian Streaming for Fast and Compact Reconstruction of Dynamic Scenescited by 12
- 20254DGCPro: Efficient Hierarchical 4D Gaussian Compression for Progressive Volumetric Video Streamingcited by 11
- 2025MAPo : Motion-Aware Partitioning of Deformable 3D Gaussian Splatting for High-Fidelity Dynamic Scene Reconstructioncited by 3
- 2026ClipGStream: Clip-Stream Gaussian Splatting for Any Length and Any Motion Multi-View Dynamic Scene Reconstructioncited by 3
- 2025Semantics versus Identity: A Divide-and-Conquer Approach towards Adjustable Medical Image De-Identificationcited by 2
- 20254D-MoDe: Towards Editable and Scalable Volumetric Streaming via Motion-Decoupled 4D Gaussian Compressioncited by 2
- 2026LoD-Structured 3D Gaussian Splatting for Streaming Video Reconstructioncited by 2
- 2026MoRGS: Efficient Per-Gaussian Motion Reasoning for Streamable Dynamic 3D Scenescited by 2
- 2025PrismGS: Physically-Grounded Anti-Aliasing for High-Fidelity Large-Scale 3D Gaussian Splattingcited by 1
- 2025AlignGS: Aligning Geometry and Semantics for Robust Indoor Reconstruction from Sparse Viewscited by 1
- 2026GenSplatCodec: Feed-Forward Gaussian Splatting Compression via One-Step Diffusioncited by 1
- 2025Do Flat Minima Improve Sparse Novel View Synthesis?cited by 0
12 most cited of 26 All 26 (JSON)
- 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstruction30 Sep 2026
- 2026Gaussian Splatting-based Volumetric Video Compression with Sparse 4D Anchors27 Sep 2026
- 2026ADATEX4D: adaptive texture capacity allocation for 4D gaussian splatting24 Sep 2026
- 2026Robust, Estimator-Agnostic Dynamic 3DGS Compression22 Sep 2026
- 2026DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streaming15 Sep 2026
- 2026CC-4DGS: Computational Deformation and Point-Cloud Compression for Storage-Efficient Dynamic Gaussian Splatting2 Sep 2026
- 2026S2GS: Structured Sparse Gaussian Streaming for Efficient Free-Viewpoint Video Reconstruction on Edge-IoT Devices20 Aug 2026
- 2026GenSplatCodec: Feed-Forward Gaussian Splatting Compression via One-Step Diffusion27 Jul 2026
- 2026DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streaming27 Jun 2026
- 20264D Reconstruction from Sparse Dynamic Cameras3 Jun 2026
- 2026GeoRect4D: Geometry-Compatible Generative Rectification for Dynamic Sparse-View 3D Reconstruction22 Apr 2026
- 2026ClipGStream: Clip-Stream Gaussian Splatting for Any Length and Any Motion Multi-View Dynamic Scene Reconstruction15 Apr 2026
12 newest of 26 All 26 (JSON)