Bringing a Personal Point of View: Evaluating Dynamic 3D Gaussian Splatting for Egocentric Scene Reconstruction
Not on the map. Why?
Abstract (arXiv)
Egocentric video provides a unique view into human perception and interaction, with growing relevance for augmented reality, robotics, and assistive technologies. However, rapid camera motion and complex scene dynamics pose major challenges for 3D reconstruction from this perspective. While 3D Gaussian Splatting (3DGS) has become a state-of-the-art method for efficient, high-quality novel view synthesis, variants, that focus on reconstructing dynamic scenes from monocular video are rarely evaluated on egocentric video. It remains unclear whether existing models generalize to this setting or if egocentric-specific solutions are needed. In this work, we evaluate dynamic monocular 3DGS models on egocentric and exocentric video using paired ego-exo recordings from the EgoExo4D dataset. We find that reconstruction quality is consistently lower in egocentric views. Analysis reveals that the difference in reconstruction quality, measured in peak signal-to-noise ratio, stems from the reconstruction of static, not dynamic, content. Our findings underscore current limitations and motivate the development of egocentric-specific approaches, while also highlighting the value of separately evaluating static and dynamic regions of a video.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 39 of its 54 references that are in the map. First posted on arXiv 26 Apr 2026.
Builds on
39 of 54 references.
References · 39
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2021Mip-NeRF: A Multiscale Representation for Anti-Aliasing Neural Radiance Fieldscited by 1,964
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 737
- 2020Rescaling Egocentric Visioncited by 540
- 2022HOI4D: A 4D Egocentric Dataset for Category-Level Human-Object Interactioncited by 327
27 more
- 2022Assembly101: A Large-Scale Multi-View Video Dataset for Understanding Procedural Activitiescited by 287
- 2023Triplane Meets Gaussian Splatting: Fast and Generalizable Single-View 3D Reconstruction with Transformerscited by 258
- 2021H2O: Two Hands Manipulating Objects for First Person Interaction Recognitioncited by 254
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 189
- 2022EPIC-KITCHENS VISOR Benchmark: VIdeo Segmentations and Object Relationscited by 140
- 2018Charades-Ego: A Large-Scale Dataset of Paired Third and First Person Videoscited by 128
- 2023NeRF-DS: Neural Radiance Fields for Dynamic Specular Objectscited by 111
- 2024ManiGaussian: Dynamic Gaussian Splatting for Multi-task Robotic Manipulationcited by 108
- 2023GauFRe: Gaussian Deformation Fields for Real-time Dynamic Novel View Synthesiscited by 95
- 2024EgoExoLearn: A Dataset for Bridging Asynchronous Ego- and Exo-centric View of Procedural Activities in Real Worldcited by 95
- 2022Fine-Grained Egocentric Hand-Object Segmentation: Dataset, Model, and Applicationscited by 78
- 2018LSTA: Long Short-Term Attention for Egocentric Action Recognitioncited by 57
- 2023EPIC Fields: Marrying 3D Geometry and Video Understandingcited by 49
- 2024EgoLifter: Open-world 3D Segmentation for Egocentric Perceptioncited by 47
- 2024SplineGS: Robust Motion-Adaptive Spline for Real-Time Dynamic 3D Gaussians from Monocular Videocited by 44
- 2024Endo-4DGS: Endoscopic Monocular Scene Reconstruction with 4D Gaussian Splattingcited by 43
- 2024Fisheye-GS: Lightweight and Extensible Gaussian Splatting Module for Fisheye Camerascited by 24
- 2024EgoGaussian: Dynamic Scene Understanding from Egocentric Video with 3D Gaussian Splattingcited by 23
- 2023Summarize the Past to Predict the Future: Natural Language Descriptions of Context Boost Multimodal Object Interaction Anticipationcited by 21
- 2025DeGauss: Dynamic-Static Decomposition with Gaussian Splatting for Distractor-free 3D Reconstructioncited by 16
- 2025The CASTLE 2024 Dataset: Advancing the Art of Multimodal Understandingcited by 16
- 20244D Gaussian Splatting: Modeling Dynamic Scenes with Native 4D Primitivescited by 15
- 2025Visual Intention Grounding for Egocentric Assistantscited by 11
- 2024RelayGS: Reconstructing Dynamic Scenes with Large-Scale and Complex Motions via Relay Gaussianscited by 3
- 2024Gaussians on their Way: Wasserstein-Constrained 4D Gaussian Splatting with State-Space Modelingcited by 1
Built on by
Not cited yet.