mlsanityData to 7 Oct 2026

4DGC: Rate-Aware 4D Gaussian Compression for Efficient Streamable Free-Viewpoint Video

arXiv 2503.18421 ↗First posted 24 Mar 2025cs.CV eess.IVcited by 26

Not on the map. Why?

Abstract (arXiv)

3D Gaussian Splatting (3DGS) has substantial potential for enabling photorealistic Free-Viewpoint Video (FVV) experiences. However, the vast number of Gaussians and their associated attributes poses significant challenges for storage and transmission. Existing methods typically handle dynamic 3DGS representation and compression separately, neglecting motion information and the rate-distortion (RD) trade-off during training, leading to performance degradation and increased model redundancy. To address this gap, we propose 4DGC, a novel rate-aware 4D Gaussian compression framework that significantly reduces storage size while maintaining superior RD performance for FVV. Specifically, 4DGC introduces a motion-aware dynamic Gaussian representation that utilizes a compact motion grid combined with sparse compensated Gaussians to exploit inter-frame similarities. This representation effectively handles large motions, preserving quality and reducing temporal redundancy. Furthermore, we present an end-to-end compression scheme that employs differentiable quantization and a tiny implicit entropy model to compress the motion grid and compensated Gaussians efficiently. The entire framework is jointly optimized using a rate-distortion trade-off. Extensive experiments demonstrate that 4DGC supports variable bitrates and consistently outperforms existing methods in RD performance across multiple datasets.

Key facts. Cited by 26 papers in the map (data through 7 Oct 2026). Builds on 62 of its 77 references that are in the map. First posted on arXiv 24 Mar 2025.

Builds on

62 of 77 references.

References · 62

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,013
  4. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  5. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
  6. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,230
  7. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,194
  8. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  9. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,061
  10. 2018Variational image compression with a scale hyperpriorcited by 910
  11. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  12. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
38 more
  1. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
  2. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
  3. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
  4. 2023pixelSplat: 3D Gaussian Splats from Image Pairs for Scalable Generalizable 3D Reconstructioncited by 668
  5. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
  6. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
  7. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  8. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
  9. 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
  10. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 344
  11. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 341
  12. 2018DVC: An End-to-end Deep Video Compression Frameworkcited by 324
  13. 2020CompressAI: a PyTorch library and evaluation platform for end-to-end compression researchcited by 271
  14. 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
  15. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  16. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  17. 2023MERF: Memory-Efficient Radiance Fields for Real-time View Synthesis in Unbounded Scenescited by 215
  18. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
  19. 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
  20. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
  21. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 156
  22. 2017Soft-to-Hard Vector Quantization for End-to-End Learning Compressible Representationscited by 149
  23. 2023CompGS: Smaller and Faster Gaussian Splatting with Vector Quantizationcited by 127
  24. 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 126
  25. 2022Streaming Radiance Fields for 3D Video Synthesiscited by 118
  26. 2021Temporal Context Mining for Learned Video Compressioncited by 112
  27. 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
  28. 2024ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Modelcited by 98
  29. 2024FlashGS: Efficient 3D Gaussian Splatting for Large-scale and High-resolution Renderingcited by 85
  30. 2023Neural Residual Radiance Fields for Streamably Free-Viewpoint Videoscited by 77
  31. 2017Learning Convolutional Networks for Content-weighted Image Compressioncited by 73
  32. 2016End-to-end optimization of nonlinear transform codes for perceptual qualitycited by 72
  33. 2023HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splattingcited by 68
  34. 2023DBARF: Deep Bundle-Adjusting Generalizable Neural Radiance Fieldscited by 60
  35. 2023Temporal Interpolation Is All You Need for Dynamic Neural Radiance Fieldscited by 59
  36. 2022Masked Wavelet Representation for Compact Neural Radiance Fieldscited by 57
  37. 2023CamP: Camera Preconditioning for Neural Radiance Fieldscited by 55
  38. 2023Representing Volumetric Videos as Dynamic MLP Mapscited by 51

50 most cited of 62 All 62 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 8; 2026: 18.

26 papers.

Sort:

  1. 2025ReCon-GS: Continuum-Preserved Gaussian Streaming for Fast and Compact Reconstruction of Dynamic Scenescited by 12
  2. 20254DGCPro: Efficient Hierarchical 4D Gaussian Compression for Progressive Volumetric Video Streamingcited by 11
  3. 2025MAPo : Motion-Aware Partitioning of Deformable 3D Gaussian Splatting for High-Fidelity Dynamic Scene Reconstructioncited by 3
  4. 2026ClipGStream: Clip-Stream Gaussian Splatting for Any Length and Any Motion Multi-View Dynamic Scene Reconstructioncited by 3
  5. 2025Semantics versus Identity: A Divide-and-Conquer Approach towards Adjustable Medical Image De-Identificationcited by 2
  6. 20254D-MoDe: Towards Editable and Scalable Volumetric Streaming via Motion-Decoupled 4D Gaussian Compressioncited by 2
  7. 2026LoD-Structured 3D Gaussian Splatting for Streaming Video Reconstructioncited by 2
  8. 2026MoRGS: Efficient Per-Gaussian Motion Reasoning for Streamable Dynamic 3D Scenescited by 2
  9. 2025PrismGS: Physically-Grounded Anti-Aliasing for High-Fidelity Large-Scale 3D Gaussian Splattingcited by 1
  10. 2025AlignGS: Aligning Geometry and Semantics for Robust Indoor Reconstruction from Sparse Viewscited by 1
  11. 2026GenSplatCodec: Feed-Forward Gaussian Splatting Compression via One-Step Diffusioncited by 1
  12. 2025Do Flat Minima Improve Sparse Novel View Synthesis?cited by 0
14 more
  1. 2026Lightweight High-Fidelity Low-Bitrate Talking Face Compression for 3D Video Conferencecited by 0
  2. 2026HPC: Hierarchical Point-based Latent Representation for Streaming Dynamic Gaussian Splatting Compressioncited by 0
  3. 2026Constrained Dynamic Gaussian Splattingcited by 0
  4. 2026Fast and Robust Deformable 3D Gaussian Splattingcited by 0
  5. 2026GeoRect4D: Geometry-Compatible Generative Rectification for Dynamic Sparse-View 3D Reconstructioncited by 0
  6. 20264D Reconstruction from Sparse Dynamic Camerascited by 0
  7. 2026DLGStream: Dynamic Language-embedded Guassian Splatting for Open-vocabulary Enabled Free-viewpoint Video Streamingcited by 0
  8. 2026S2GS: Structured Sparse Gaussian Streaming for Efficient Free-Viewpoint Video Reconstruction on Edge-IoT Devicescited by 0
  9. 2026CC-4DGS: Computational Deformation and Point-Cloud Compression for Storage-Efficient Dynamic Gaussian Splattingcited by 0
  10. 2026DecoGS: Adaptive Static-Dynamic Decoupling of 3D Gaussians for Free-Viewpoint Video Streamingcited by 0
  11. 2026Robust, Estimator-Agnostic Dynamic 3DGS Compressioncited by 0
  12. 2026ADATEX4D: adaptive texture capacity allocation for 4D gaussian splattingcited by 0
  13. 2026Gaussian Splatting-based Volumetric Video Compression with Sparse 4D Anchorscited by 0
  14. 2026Reconstructing the Dynamic World: A Representation-Centric View of 4D Scene Reconstructioncited by 0