mlsanityData to 14 Oct 2026

4D-MoDe: Towards Editable and Scalable Volumetric Streaming via Motion-Decoupled 4D Gaussian Compression

arXiv 2509.17506 ↗First posted 22 Sep 2025cs.CVcited by 2

Not on the map. Why?

Abstract (arXiv)

Volumetric video has emerged as a key medium for immersive telepresence and augmented/virtual reality, enabling six-degrees-of-freedom (6DoF) navigation and realistic spatial interactions. However, delivering high-quality dynamic volumetric content at scale remains challenging due to massive data volume, complex motion, and limited editability of existing representations. In this paper, we present 4D-MoDe, a motion-decoupled 4D Gaussian compression framework designed for scalable and editable volumetric video streaming. Our method introduces a layered representation that explicitly separates static backgrounds from dynamic foregrounds using a lookahead-based motion decomposition strategy, significantly reducing temporal redundancy and enabling selective background/foreground streaming. To capture continuous motion trajectories, we employ a multi-resolution motion estimation grid and a lightweight shared MLP, complemented by a dynamic Gaussian compensation mechanism to model emergent content. An adaptive grouping scheme dynamically inserts background keyframes to balance temporal consistency and compression efficiency. Furthermore, an entropy-aware training pipeline jointly optimizes the motion fields and Gaussian parameters under a rate-distortion (RD) objective, while employing range-based and KD-tree compression to minimize storage overhead. Extensive experiments on multiple datasets demonstrate that 4D-MoDe consistently achieves competitive reconstruction quality with an order of magnitude lower storage cost (e.g., as low as 11.4 KB/frame) compared to state-of-the-art methods, while supporting practical applications such as background replacement and foreground-only streaming.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 58 of its 72 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

58 of 72 references.

References · 58

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
  3. 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
  4. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
  5. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  6. 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
  7. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  8. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  9. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  10. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  11. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  12. 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
38 more
  1. 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
  2. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  3. 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
  4. 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 436
  5. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
  6. 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
  7. 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 346
  8. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
  9. 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
  10. 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
  11. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  12. 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
  13. 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 209
  14. 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 174
  15. 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
  16. 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
  17. 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 160
  18. 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 152
  19. 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 127
  20. 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
  21. 2022Streaming Radiance Fields for 3D Video Synthesiscited by 119
  22. 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
  23. 2024ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Modelcited by 102
  24. 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
  25. 20243DGSR: Implicit Surface Reconstruction with 3D Gaussian Splattingcited by 79
  26. 2023Neural Residual Radiance Fields for Streamably Free-Viewpoint Videoscited by 77
  27. 2023HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splattingcited by 70
  28. 20243DGS.zip: A survey on 3D Gaussian Splatting Compression Methodscited by 69
  29. 2023Temporal Interpolation Is All You Need for Dynamic Neural Radiance Fieldscited by 59
  30. 2024DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representationcited by 58
  31. 2022Masked Wavelet Representation for Compact Neural Radiance Fieldscited by 57
  32. 2024GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Meshcited by 51
  33. 2024Splatter a Video: Video Gaussian Representation for Versatile Processingcited by 31
  34. 2024Robust Dual Gaussian Splatting for Immersive Human-centric Volumetric Videoscited by 30
  35. 2024V^3: Viewing Volumetric Videos on Mobiles via Streamable 2D Dynamic Gaussianscited by 29
  36. 20254DGC: Rate-Aware 4D Gaussian Compression for Efficient Streamable Free-Viewpoint Videocited by 27
  37. 2024QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint Videoscited by 25
  38. 2025Lifting by Gaussians: A Simple, Fast and Flexible Method for 3D Instance Segmentationcited by 23

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.