PackUV: Packed Gaussian UV Maps for 4D Volumetric Video
Not on the map. Why?
Abstract (arXiv)
Volumetric videos offer immersive 4D experiences, but remain difficult to reconstruct, store, and stream at scale. Existing Gaussian Splatting based methods achieve high-quality reconstruction but break down on long sequences, temporal inconsistency, and fail under large motions and disocclusions. Moreover, their outputs are typically incompatible with conventional video coding pipelines, preventing practical applications. We introduce PackUV, a novel 4D Gaussian representation that maps all Gaussian attributes into a sequence of structured, multi-scale UV atlas, enabling compact, image-native storage. To fit this representation from multi-view videos, we propose PackUV-GS, a temporally consistent fitting method that directly optimizes Gaussian parameters in the UV domain. A flow-guided Gaussian labeling and video keyframing module identifies dynamic Gaussians, stabilizes static regions, and preserves temporal coherence even under large motions and disocclusions. The resulting UV atlas format is the first unified volumetric video representation compatible with standard video codecs (e.g., FFV1) without losing quality, enabling efficient streaming within existing multimedia infrastructure. To evaluate long-duration volumetric capture, we present PackUV-2B, the largest multi-view video dataset to date, featuring more than 50 synchronized cameras, substantial motion, and frequent disocclusions across 100 sequences and 2B (billion) frames. Extensive experiments demonstrate that our method surpasses existing baselines in rendering fidelity while scaling to sequences up to 30 minutes with consistent quality.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 65 of its 94 references that are in the map. First posted on arXiv 26 Feb 2026.
Builds on
65 of 94 references.
References · 65
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,459
- 2022TensoRF: Tensorial Radiance Fieldscited by 1,275
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 742
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
- 2021Neural Fields in Visual Computing and Beyondcited by 539
38 more
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 470
- 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
- 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
- 2023SC-GS: Sparse-Controlled Gaussian Splatting for Editable Dynamic Scenescited by 339
- 2020Single-View View Synthesis with Multiplane Imagescited by 263
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 210
- 2024Mini-Splatting: Representing Scenes with a Constrained Number of Gaussianscited by 208
- 2024Taming 3DGS: High-Quality Radiance Fields with Limited Resourcescited by 198
- 2019Pushing the Boundaries of View Extrapolation with Multiplane Imagescited by 191
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 185
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 173
- 2022Fourier PlenOctrees for Dynamic Radiance Field Rendering in Real-timecited by 164
- 2023HumanRF: High-Fidelity Neural Radiance Fields for Humans in Motioncited by 161
- 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 156
- 2023Compact 3D Scene Representation via Self-Organizing Gaussian Gridscited by 147
- 2016Learning-Based View Synthesis for Light Field Camerascited by 145
- 2024Reducing the Memory Footprint of 3D Gaussian Splattingcited by 129
- 2023CompGS: Smaller and Faster Gaussian Splatting with Vector Quantizationcited by 127
- 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 126
- 2025Frame Context Packing and Drift Prevention in Next-Frame-Prediction Video Diffusion Modelscited by 126
- 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
- 2019Neural Rerendering in the Wildcited by 121
- 2022Streaming Radiance Fields for 3D Video Synthesiscited by 118
- 2023NeRF-DS: Neural Radiance Fields for Dynamic Specular Objectscited by 110
- 2024RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPScited by 110
- 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
- 20234K4D: Real-Time 4D View Synthesis at 4K Resolutioncited by 91
- 2023Neural Residual Radiance Fields for Streamably Free-Viewpoint Videoscited by 77
- 2024Fully Explicit Dynamic Gaussian Splattingcited by 75
- 2024View-Consistent 3D Editing with Gaussian Splattingcited by 67
- 20204D Visualization of Dynamic Events from Unconstrained Multi-View Videoscited by 66
- 2020MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Imagescited by 64
- 2024Representing Long Volumetric Video with Temporal Gaussian Hierarchycited by 58
- 2023Im4D: High-Fidelity and Real-Time Novel View Synthesis for Dynamic Scenescited by 55
- 2023Representing Volumetric Videos as Dynamic MLP Mapscited by 51
- 2024Grid4D: 4D Decomposed Hash Encoding for High-Fidelity Dynamic Gaussian Splattingcited by 49
- 2024Trimming the Fat: Efficient Compression of 3D Gaussian Splats through Pruningcited by 45
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.