4D-MoDe: Towards Editable and Scalable Volumetric Streaming via Motion-Decoupled 4D Gaussian Compression
Not on the map. Why?
Abstract (arXiv)
Volumetric video has emerged as a key medium for immersive telepresence and augmented/virtual reality, enabling six-degrees-of-freedom (6DoF) navigation and realistic spatial interactions. However, delivering high-quality dynamic volumetric content at scale remains challenging due to massive data volume, complex motion, and limited editability of existing representations. In this paper, we present 4D-MoDe, a motion-decoupled 4D Gaussian compression framework designed for scalable and editable volumetric video streaming. Our method introduces a layered representation that explicitly separates static backgrounds from dynamic foregrounds using a lookahead-based motion decomposition strategy, significantly reducing temporal redundancy and enabling selective background/foreground streaming. To capture continuous motion trajectories, we employ a multi-resolution motion estimation grid and a lightweight shared MLP, complemented by a dynamic Gaussian compensation mechanism to model emergent content. An adaptive grouping scheme dynamically inserts background keyframes to balance temporal consistency and compression efficiency. Furthermore, an entropy-aware training pipeline jointly optimizes the motion fields and Gaussian parameters under a rate-distortion (RD) objective, while employing range-based and KD-tree compression to minimize storage overhead. Extensive experiments on multiple datasets demonstrate that 4D-MoDe consistently achieves competitive reconstruction quality with an order of magnitude lower storage cost (e.g., as low as 11.4 KB/frame) compared to state-of-the-art methods, while supporting practical applications such as background replacement and foreground-only streaming.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 58 of its 72 references that are in the map. First posted on arXiv 22 Sep 2025.
Builds on
58 of 72 references.
References · 58
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,723
- 2021Mip-NeRF 360: Unbounded Anti-Aliased Neural Radiance Fieldscited by 2,032
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2020NeRF in the Wild: Neural Radiance Fields for Unconstrained Photo Collectionscited by 1,232
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
38 more
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2020Dynamic Neural Radiance Fields for Monocular 4D Facial Avatar Reconstructioncited by 467
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 436
- 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 347
- 2022Fast Dynamic Radiance Fields with Time-Aware Neural Voxelscited by 346
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2020Neural Radiance Flow for 4D View Synthesis and Video Processingcited by 270
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 209
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 174
- 2023GaussianEditor: Editing 3D Gaussians Delicately with Text Instructionscited by 168
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
- 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 160
- 2022NeRFPlayer: A Streamable Dynamic Scene Representation with Decomposed Neural Radiance Fieldscited by 152
- 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 127
- 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
- 2022Streaming Radiance Fields for 3D Video Synthesiscited by 119
- 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
- 2024ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Modelcited by 102
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 20243DGSR: Implicit Surface Reconstruction with 3D Gaussian Splattingcited by 79
- 2023Neural Residual Radiance Fields for Streamably Free-Viewpoint Videoscited by 77
- 2023HiFi4G: High-Fidelity Human Performance Rendering via Compact Gaussian Splattingcited by 70
- 20243DGS.zip: A survey on 3D Gaussian Splatting Compression Methodscited by 69
- 2023Temporal Interpolation Is All You Need for Dynamic Neural Radiance Fieldscited by 59
- 2024DreamMesh4D: Video-to-4D Generation with Sparse-Controlled Gaussian-Mesh Hybrid Representationcited by 58
- 2022Masked Wavelet Representation for Compact Neural Radiance Fieldscited by 57
- 2024GoMAvatar: Efficient Animatable Human Modeling from Monocular Video Using Gaussians-on-Meshcited by 51
- 2024Splatter a Video: Video Gaussian Representation for Versatile Processingcited by 31
- 2024Robust Dual Gaussian Splatting for Immersive Human-centric Volumetric Videoscited by 30
- 2024V^3: Viewing Volumetric Videos on Mobiles via Streamable 2D Dynamic Gaussianscited by 29
- 20254DGC: Rate-Aware 4D Gaussian Compression for Efficient Streamable Free-Viewpoint Videocited by 27
- 2024QUEEN: QUantized Efficient ENcoding of Dynamic Gaussians for Streaming Free-viewpoint Videoscited by 25
- 2025Lifting by Gaussians: A Simple, Fast and Flexible Method for 3D Instance Segmentationcited by 23
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
- 2026Gaussian Splatting-based Volumetric Video Compression with Sparse 4D Anchors27 Sep 2026
- 2026Constrained Dynamic Gaussian Splatting3 Feb 2026