ImViD: Immersive Volumetric Videos for Enhanced VR Engagement
Not on the map. Why?
Abstract (arXiv)
User engagement is greatly enhanced by fully immersive multi-modal experiences that combine visual and auditory stimuli. Consequently, the next frontier in VR/AR technologies lies in immersive volumetric videos with complete scene capture, large 6-DoF interaction space, multi-modal feedback, and high resolution & frame-rate contents. To stimulate the reconstruction of immersive volumetric videos, we introduce ImViD, a multi-view, multi-modal dataset featuring complete space-oriented data capture and various indoor/outdoor scenarios. Our capture rig supports multi-view video-audio capture while on the move, a capability absent in existing datasets, significantly enhancing the completeness, flexibility, and efficiency of data capture. The captured multi-view videos (with synchronized audios) are in 5K resolution at 60FPS, lasting from 1-5 minutes, and include rich foreground-background elements, and complex dynamics. We benchmark existing methods using our dataset and establish a base pipeline for constructing immersive volumetric videos from multi-view audiovisual inputs for 6-DoF multi-modal immersive VR experiences. The benchmark and the reconstruction and interaction results demonstrate the effectiveness of our dataset and baseline method, which we believe will stimulate future research on immersive volumetric video production.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 42 of its 62 references that are in the map. First posted on arXiv 18 Mar 2025.
Builds on
42 of 62 references.
References · 42
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2023K-Planes: Explicit Radiance Fields in Space, Time, and Appearancecited by 746
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2023Scaffold-GS: Structured 3D Gaussians for View-Adaptive Renderingcited by 695
- 2020Neural Body: Implicit Neural Representations with Structured Latent Codes for Novel View Synthesis of Dynamic Humanscited by 634
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2022Tensor4D : Efficient Neural 4D Decomposition for High-fidelity Dynamic Reconstruction and Renderingcited by 217
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
30 more
- 2024GaussianPro: 3D Gaussian Splatting with Progressive Propagationcited by 200
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 189
- 2023HyperReel: High-Fidelity 6-DoF Video with Ray-Conditioned Samplingcited by 174
- 2016Panoptic Studio: A Massively Multiview System for Social Interaction Capturecited by 173
- 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
- 20243DGStream: On-the-Fly Training of 3D Gaussians for Efficient Streaming of Photo-Realistic Free-Viewpoint Videoscited by 160
- 2021Efficient Neural Radiance Fields for Interactive Free-viewpoint Videocited by 150
- 2022D2NeRF: Self-Supervised Decoupling of Dynamic and Static Objects from a Monocular Videocited by 137
- 2022Mixed Neural Voxels for Fast Multi-view Video Synthesiscited by 127
- 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
- 2022Streaming Radiance Fields for 3D Video Synthesiscited by 119
- 2024Gaussian in the Wild: 3D Gaussian Splatting for Unconstrained Image Collectionscited by 117
- 2024Motion-aware 3D Gaussian Splatting for Efficient Dynamic Scene Reconstructioncited by 100
- 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
- 2024NeRF On-the-go: Exploiting Uncertainty for Distractor-free NeRFs in the Wildcited by 85
- 2024Spec-Gaussian: Anisotropic View-Dependent Appearance for 3D Gaussian Splattingcited by 74
- 2023A Compact Dynamic 3D Gaussian Representation for Real-Time Dynamic View Synthesiscited by 59
- 2024GeoGaussian: Geometry-aware Gaussian Splatting for Scene Renderingcited by 52
- 2023AV-NeRF: Learning Neural Fields for Real-World Audio-Visual Scene Synthesiscited by 49
- 2023SWinGS: Sliding Windows for Dynamic 3D Gaussian Splattingcited by 46
- 2023Deformable 3D Gaussian Splatting for Animatable Human Avatarscited by 44
- 2023Masked Space-Time Hash Encoding for Efficient Dynamic Scene Reconstructioncited by 43
- 2024360+x: A Panoptic Multi-modal Scene Understanding Datasetcited by 35
- 2023Gaussian Splatting with NeRF-based Color and Opacitycited by 30
- 2024Compact 3D Gaussian Splatting for Static and Dynamic Radiance Fieldscited by 25
- 2023DiVa-360: The Dynamic Visual Dataset for Immersive Neural Fieldscited by 17
- 2024AV-GS: Learning Material and Geometry Aware Priors for Novel View Acoustic Synthesiscited by 14
- 2024NeRAF: 3D Scene Infused Neural Radiance and Acoustic Fieldscited by 9
- 2023Replay: Multi-modal Multi-view Acted Videos for Casual Holographycited by 7
- 2024SOAF: Scene Occlusion-aware Neural Acoustic Fieldcited by 3
Built on by
Citing papers per year: 2026: 3.
3 papers.