mlsanityData to 7 Oct 2026

M3ISR: A Multi-Modal Multi-View Benchmark for 3D/4D Gaussian Splatting and Feedforward Compression

arXiv 2608.22465 ↗First posted 23 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

High-fidelity free-viewpoint video (FVV) and interactive rendering increasingly rely on explicit Gaussian representations, yet practical deployment remains constrained by representation size, dynamic updates, and computational cost. Existing multi-view video benchmarks provide valuable real-captured content, but they make it difficult to isolate the effects of controlled camera geometry, representation efficiency, and temporal redundancy. We introduce M3ISR, a controlled synthetic benchmark for 3D and 4D Gaussian Splatting (3DGS/4DGS). The benchmark contains 25 scenes from five indoor and outdoor scene groups, two camera/motion configurations, six synchronized 1080p views, and dense ground-truth annotations including RGB, camera parameters, depth, semantic and instance segmentation, and static--dynamic masks. The shared-center camera design intentionally isolates angular view variation and enables controlled evaluation of novel-view synthesis and representation efficiency. We organize M3ISR into five complementary tracks covering 3DGS synthesis, 4DGS synthesis, 4DGS streaming, 3DGS compression, and 4DGS compression. Representative baseline results show small differences in static reconstruction quality but substantial differences in representation storage, while the evaluated streaming methods exhibit substantially higher reported training or reconstruction cost than the corresponding offline dynamic reconstruction baselines. We further define feedforward compression tasks for 3DGS and 4DGS and provide reference rate--distortion formulations and preliminary baseline evaluations. The benchmark is intended as a controlled and complementary testbed for systematic study of Gaussian-based FVV reconstruction, compression, and streaming.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 36 of its 49 references that are in the map. First posted on arXiv 23 Aug 2026.

Builds on

36 of 49 references.

References · 36

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
  2. 2022Instant Neural Graphics Primitives with a Multiresolution Hash Encodingcited by 3,698
  3. 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,957
  4. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
  5. 2018Variational image compression with a scale hyperpriorcited by 910
  6. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
  7. 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 684
  8. 2018Joint Autoregressive and Hierarchical Priors for Learned Image Compressioncited by 642
  9. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 582
  10. 2020Learned Image Compression with Discretized Gaussian Mixture Likelihoods and Attention Modulescited by 570
  11. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 514
  12. 2023Ego-Exo4D: Understanding Skilled Human Activity from First- and Third-Person Perspectivescited by 477
24 more
  1. 2023LightGaussian: Unbounded 3D Gaussian Compression with 15x Reduction and 200+ FPScited by 420
  2. 2023Compact 3D Gaussian Representation for Radiance Fieldcited by 365
  3. 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 321
  4. 2023FSGS: Real-Time Few-shot View Synthesis using Gaussian Splattingcited by 278
  5. 2021BungeeNeRF: Progressive Neural Radiance Field for Extreme Multi-scale Scene Renderingcited by 228
  6. 2020The EPIC-KITCHENS Dataset: Collection, Challenges and Baselinescited by 221
  7. 2024HAC: Hash-grid Assisted Context for 3D Gaussian Splatting Compressioncited by 202
  8. 2023Compact 3D Scene Representation via Self-Organizing Gaussian Gridscited by 147
  9. 2024CoR-GS: Sparse-View 3D Gaussian Splatting via Co-Regularizationcited by 120
  10. 2022Streaming Radiance Fields for 3D Video Synthesiscited by 118
  11. 2024ContextGS: Compact 3D Gaussian Splatting with Anchor Level Context Modelcited by 98
  12. 2023Neural Residual Radiance Fields for Streamably Free-Viewpoint Videoscited by 77
  13. 2020OctSqueeze: Octree-Structured Entropy Model for LiDAR Compressioncited by 72
  14. 2025DropGaussian: Structural Regularization for Sparse-view Gaussian Splattingcited by 65
  15. 2021VoxelContext-Net: An Octree based Framework for Point Cloud Compressioncited by 60
  16. 2024Fast Feedforward 3D Gaussian Splatting Compressioncited by 49
  17. 2025Instant Gaussian Stream: Fast and Generalizable Streaming of Dynamic Scene Reconstruction via Gaussian Splattingcited by 35
  18. 2024HEMGS: A Hybrid Entropy Model for 3D Gaussian Splatting Data Compressioncited by 31
  19. 2025D-FCGS: Feedforward Compression of Dynamic Gaussian Splatting for Free-Viewpoint Videoscited by 6
  20. 2025An Efficient Adaptive Compression Method for Human Perception and Machine Vision Taskscited by 5
  21. 20254DGS-CC: A Contextual Coding Framework for 4D Gaussian Splatting Data Compressioncited by 5
  22. 20253D Gaussian Splatting Data Compression with Mixture of Priorscited by 5
  23. 2024Towards Point Cloud Compression for Machine Perception: A Simple and Strong Baseline by Learning the Octree Depth Level Predictorcited by 4
  24. 2026LoD-Structured 3D Gaussian Splatting for Streaming Video Reconstructioncited by 2

Built on by

Not cited yet.