mlsanityData to 14 Oct 2026

Future Rendering neq Future Surface: A Benchmark and Dataset for Dynamic Surface Reconstruction Beyond the Observed Window

arXiv 2607.21471 ↗First posted 23 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Dynamic-scene reconstruction is almost always evaluated inside the observed time window, yet deployment settings such as AR overlays, robot interaction, and anticipatory planning need the future surface: the geometry at times beyond those captured. No standard benchmark measures this. We introduce FutureSurf, a controlled diagnostic benchmark and dataset for future-time surface reconstruction that trades scene diversity for exact future ground truth and falsification controls. A method trains on the observed first 75% of a sequence; we score its extracted per-frame surface on the held-out future by Chamfer distance, reporting absolute future CD as the primary score and the future/observed gap as a diagnostic. The dataset contains eight analytically defined controlled motions, including three falsification controls, with exact per-frame ground-truth meshes. We also provide a ground-truth-side recoverability oracle. The release includes split files, scoring code, a benchmark card, and Croissant metadata. On the controlled motions, the DG-Mesh backbone leaves a 2.7-4.1× gap even for futures predictable in principle (four of five recoverable from observed motion by a fixed rule), while the falsification controls behave as designed (the surface-invariant motion shows no gap). Beyond the contributed dataset, the gap persists across six animated DG-Mesh asset scenes and a second backbone, Deformable-3DGS (2.0-6.6×; both share a deformation-MLP temporal model). The benchmark also shows that future rendering quality and future-surface accuracy are statistically decoupled, so the novel-view-synthesis metrics the field reports do not track future geometry. The future error is structured, concentrating where the surface moves. The dataset, evaluation toolkit, and scoring code are available on Hugging Face and GitHub (https://github.com/Ricky-S/futuresurf).

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 28 references that are in the map. First posted on arXiv 23 Jul 2026.

Builds on

27 of 28 references.

References · 27

  1. 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,226
  2. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  3. 2020D-NeRF: Neural Radiance Fields for Dynamic Scenescited by 1,465
  4. 2018Datasheets for Datasetscited by 1,386
  5. 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,157
  6. 2018Model Cards for Model Reportingcited by 1,080
  7. 20242D Gaussian Splatting for Geometrically Accurate Radiance Fieldscited by 1,076
  8. 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 759
  9. 2022Kubric: A scalable dataset generatorcited by 381
  10. 2023PhysGaussian: Physics-Integrated 3D Gaussians for Generative Dynamicscited by 377
  11. 2022Monocular Dynamic View Synthesis: A Reality Checkcited by 200
  12. 2024Reconstruction and Simulation of Elastic Objects with Spring-Mass 3D Gaussianscited by 97
15 more
  1. 2024Croissant: A Metadata Format for ML-Ready Datasetscited by 81
  2. 2024GIC: Gaussian-Informed Continuum for Physical Property Identification and Simulationcited by 49
  3. 2024GaussianPrediction: Dynamic 3D Gaussian Prediction for Motion Extrapolation and Free View Synthesiscited by 25
  4. 2024Dynamic Gaussians Mesh: Consistent Mesh Reconstruction from Dynamic Scenescited by 22
  5. 2025FluidNexus: 3D Fluid Reconstruction and Prediction from a Single Videocited by 21
  6. 2024DynaSurfGS: Dynamic Surface Reconstruction with Planar-based Gaussian Splattingcited by 19
  7. 2025GauSTAR: Gaussian Surface Tracking and Reconstructioncited by 13
  8. 2025ODE-GS: Latent ODEs for Dynamic Scene Extrapolation with 3D Gaussian Splattingcited by 11
  9. 2024Space-time 2D Gaussian Splatting for Accurate Surface Reconstruction under Complex Dynamic Scenescited by 6
  10. 2026ReconPhys: Reconstruct Appearance and Physical Attributes from Single Videocited by 5
  11. 20254D Gaussian Splatting as a Learned Dynamical Systemcited by 4
  12. 2026Space-Time Forecasting of Dynamic Scenes with Motion-aware Gaussian Groupingcited by 3
  13. 2026GP-4DGS: Probabilistic 4D Gaussian Splatting from Monocular Video via Variational Gaussian Processescited by 2
  14. 2026textit4DSurf: High-Fidelity Dynamic Scene Surface Reconstructioncited by 1
  15. 2026DySurface: Consistent 4D Surface Reconstruction via Bridging Explicit Gaussians and Implicit Functionscited by 1

Built on by

Not cited yet.