mlsanityData to 14 Oct 2026

FillGS: Filling Observation Gaps in 4D Gaussian Splatting via Viewpoint-Time Selection and Generative Refinement

arXiv 2607.29284 ↗First posted 31 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

4D Gaussian Splatting (4DGS) can render dynamic scenes photorealistically. However, with limited viewpoint coverage, some spatiotemporal regions remain sparsely observed, leading to artifacts, particularly in scenes with large motion. Existing approaches leveraging generative models rely on heuristic virtual-viewpoint selection before refining rendered views. As a result, they cannot actively explore such sparsely observed regions. To address this issue, we propose a pipeline that actively selects spatiotemporal virtual viewpoints to improve 4DGS reconstruction. Our method selects virtual viewpoints for generative enhancement based on the rendering sensitivity and motion-aware observation density of 4D Gaussians, prioritizing views that alleviate observation sparsity. In the refined images, we filter out regions that conflict with captured observations or are likely to contain generative artifacts and then fine-tune 4DGS using only the reliable regions. We evaluate our method on multi-view video benchmarks using new train/test splits designed to induce observation gaps. Results show consistent improvements over prior viewpoint selection strategies and fine-tuning methods in both qualitative and quantitative evaluations, while reducing artifacts.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 61 of its 72 references that are in the map. First posted on arXiv 31 Jul 2026.

Builds on

61 of 72 references.

References · 61

  1. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  2. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  3. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  4. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  5. 2020Nerfies: Deformable Neural Radiance Fieldscited by 1,198
  6. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  7. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  8. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 751
  9. 2023HexPlane: A Fast Representation for Dynamic Scenescited by 587
  10. 2023DL3DV-10K: A Large-Scale Scene Dataset for Deep Learning-based 3D Visioncited by 537
  11. 2023Real-time Photorealistic Dynamic Scene Representation and Rendering with 4D Gaussian Splattingcited by 476
  12. 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
38 more
  1. 2023Spacetime Gaussian Feature Splatting for Real-Time Dynamic View Synthesiscited by 344
  2. 2024Shape of Motion: 4D Reconstruction from a Single Videocited by 250
  3. 2022DynIBaR: Neural Dynamic Image-Based Renderingcited by 224
  4. 2023Gaussian-Flow: 4D Reconstruction with Dynamic 3D Gaussian Particlecited by 211
  5. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
  6. 20244D-Rotor Gaussian Splatting: Towards Efficient Novel View Synthesis for Dynamic Scenescited by 189
  7. 2024MoSca: Dynamic Gaussian Fusion from Casual Videos via 4D Motion Scaffoldscited by 179
  8. 2020Novel View Synthesis of Dynamic Scenes with Globally Coherent Depths from a Monocular Cameracited by 166
  9. 2025Difix3D+: Improving 3D Reconstructions with Single-Step Diffusion Modelscited by 161
  10. 2022ActiveNeRF: Learning where to See with Uncertainty Estimationcited by 127
  11. 2023DynMF: Neural Motion Factorization for Real-time Dynamic View Synthesis with 3D Gaussian Splattingcited by 124
  12. 20243D Geometry-aware Deformable Gaussian Splatting for Dynamic View Synthesiscited by 109
  13. 20243DGS-Enhancer: Enhancing Unbounded 3D Gaussian Splatting with View-consistent 2D Diffusion Priorscited by 106
  14. 2024Per-Gaussian Embedding-Based Deformation for Deformable 3D Gaussian Splattingcited by 104
  15. 2024Dynamic Gaussian Marbles for Novel View Synthesis of Casual Monocular Videoscited by 97
  16. 20234K4D: Real-Time 4D View Synthesis at 4K Resolutioncited by 91
  17. 2021Neural Trajectory Fields for Dynamic Novel View Synthesiscited by 86
  18. 2021Stochastic Neural Radiance Fields: Quantifying Uncertainty in Implicit 3D Representationscited by 82
  19. 2024Fully Explicit Dynamic Gaussian Splattingcited by 76
  20. 2022Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fieldscited by 60
  21. 2023A Compact Dynamic 3D Gaussian Representation for Real-Time Dynamic View Synthesiscited by 59
  22. 2024Representing Long Volumetric Video with Temporal Gaussian Hierarchycited by 58
  23. 2023NeU-NBV: Next Best View Planning Using Uncertainty Estimation in Image-Based Neural Renderingcited by 54
  24. 2024MoDGS: Dynamic Gaussian Splatting from Casually-captured Monocular Videos with Depth Priorscited by 51
  25. 2025RoMa v2: Harder Better Faster Denser Feature Matchingcited by 51
  26. 2024GFlow: Recovering 4D World from Monocular Videocited by 46
  27. 2025GenFusion: Closing the Loop between Reconstruction and Generation via Videoscited by 41
  28. 2025GSFixer: Improving 3D Gaussian Splatting with Reference-Guided Video Diffusion Priorscited by 38
  29. 2024ActiveSplat: High-Fidelity Scene Reconstruction through Active Gaussian Splattingcited by 32
  30. 2022ActiveRMAP: Radiance Field for Active Mapping And Planningcited by 30
  31. 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularizationcited by 28
  32. 2025HiMoR: Monocular Deformable Gaussian Reconstruction with Hierarchical Motion Representationcited by 22
  33. 2023Improving NeRF Quality by Progressive Camera Placement for Unrestricted Navigation in Complex Environmentscited by 19
  34. 2025POp-GS: Next Best View in 3D-Gaussian Splatting with P-Optimalitycited by 18
  35. 2025GSFix3D: Diffusion-Guided Repair of Novel Views in Gaussian Splattingcited by 18
  36. 2023AutoNeRF: Training Implicit Scene Representations with Autonomous Agentscited by 10
  37. 2024Beyond Uncertainty: Risk-Aware Active View Acquisition for Safe Robot Navigation and 3D Scene Understanding with FisherRFcited by 10
  38. 2025These Magic Moments: Differentiable Uncertainty Quantification of Radiance Field Modelscited by 6

50 most cited of 61 All 61 (JSON)

Built on by

Not cited yet.