FillGS: Filling Observation Gaps in 4D Gaussian Splatting via Viewpoint-Time Selection and Generative Refinement
Not on the map. Why?
Abstract (arXiv)
4D Gaussian Splatting (4DGS) can render dynamic scenes photorealistically. However, with limited viewpoint coverage, some spatiotemporal regions remain sparsely observed, leading to artifacts, particularly in scenes with large motion. Existing approaches leveraging generative models rely on heuristic virtual-viewpoint selection before refining rendered views. As a result, they cannot actively explore such sparsely observed regions. To address this issue, we propose a pipeline that actively selects spatiotemporal virtual viewpoints to improve 4DGS reconstruction. Our method selects virtual viewpoints for generative enhancement based on the rendering sensitivity and motion-aware observation density of 4D Gaussians, prioritizing views that alleviate observation sparsity. In the refined images, we filter out regions that conflict with captured observations or are likely to contain generative artifacts and then fine-tune 4DGS using only the reliable regions. We evaluate our method on multi-view video benchmarks using new train/test splits designed to induce observation gaps. Results show consistent improvements over prior viewpoint selection strategies and fine-tuning methods in both qualitative and quantitative evaluations, while reducing artifacts.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 61 of its 72 references that are in the map. First posted on arXiv 31 Jul 2026.
Builds on
61 of 72 references.
References · 61
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
- 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
- 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
- 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
- 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
- 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
- 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
38 more
- 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
- 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
- 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
- 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
- 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
- 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 189
- 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
- 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
- 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
- 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 127
- 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
- 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
- 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
- 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
- 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 97
- 20234K4D: Real-Time 4D View Synthesis at 4K Resolutioncited by 91
- 2021Neural Trajectory Fields for Dynamic Novel View Synthesiscited by 86
- 2021Stochastic Neural Radiance Fields: Quantifying Uncertainty in Implicit 3D Representationscited by 82
- 2024Fully Explicit Dynamic Gaussian Splattingcited by 76
- 2022Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fieldscited by 60
- 2023A Compact Dynamic 3D Gaussian Representation for Real-Time Dynamic View Synthesiscited by 59
- 2024Representing Long Volumetric Video with Temporal Gaussian Hierarchycited by 58
- 2023NeU-NBV: Next Best View Planning Using Uncertainty Estimation in Image-Based Neural Renderingcited by 54
- 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
- 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 51
- 2024GFlow: Recovering 4D World from Monocular Videocited by 46
- 2025GenFusion: Closing the Loop between Reconstruction and Generation via Videoscited by 41
- 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priorscited by 38
- 2024ActiveSplat: High-Fidelity Scene Reconstruction through Active Gaussian Splattingcited by 32
- 2022ActiveRMAP: Radiance Field for Active Mapping And Planningcited by 30
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
- 2025HiMoR: Monocular Deformable Gaussian Reconstruction with Hierarchical Motion Representationcited by 22
- 2023Improving NeRF Quality by Progressive Camera Placement for Unrestricted Navigation in Complex Environmentscited by 19
- 2025POp-GS: Next Best View in 3D-Gaussian Splatting with P-Optimalitycited by 18
- 2025GSFix3D: Diffusion-Guided Repair of Novel Views in Gaussian Splattingcited by 18
- 2023AutoNeRF: Training Implicit Scene Representations with Autonomous Agentscited by 10
- 2024Beyond Uncertainty: Risk-Aware Active View Acquisition for Safe Robot Navigation and 3D Scene Understanding with FisherRFcited by 10
- 2025These Magic Moments: Differentiable Uncertainty Quantification of Radiance Field Modelscited by 6
50 most cited of 61 All 61 (JSON)
Built on by
Not cited yet.