Depth Anything V4: Dynamic 4D Scene Reconstruction via Riemannian Flow Matching on 4D Gaussian Splatting
On the map: Diffusion models → 3D, point cloud and scene generation
Abstract (arXiv)
We present Depth Anything V4 (DAV4), a framework for dynamic 4D scene reconstruction from monocular video. Our key contribution is the application of Riemannian Flow Matching (RFM) to 4D Gaussian Splatting parameters, defining probability paths directly on non-Euclidean manifolds (scale, rotation, opacity), ensuring all intermediate states are valid. Through controlled experiments, we isolate RFM's contribution from test-time optimization (TTO) and pre-training. A deterministic MLP baseline with the same data, architecture, and TTO achieves F-score 0.762; RFM achieves 0.806 - the +0.044 gain is RFM's isolated contribution. We provide corrected computational cost analysis: pre-training is 360 GPU-hours, amortizing for large-scale deployment (over 10,000 scenes). Uncertainty is quantified via Negative Gaussian Log-Likelihood and Expected Calibration Error. DAV4 outperforms prior Depth Anything models and per-scene 4D-GS on dynamic reconstruction and novel-view synthesis, while using no human-annotated depth labels as training losses.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in 3D, point cloud and scene generation, one of 14 directions in Diffusion models. Builds on 21 of its 28 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
21 of 28 references.
References · 21
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2015Dropout as a Bayesian Approximation: Representing Model Uncertainty in Deep Learningcited by 4,416
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2020RAFT: Recurrent All-Pairs Field Transforms for Optical Flowcited by 2,385
- 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,335
- 2021Vision Transformers for Dense Predictioncited by 1,789
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
- 2024Depth Anything V2cited by 1,385
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
9 more
- 2019Can You Trust Your Model's Uncertainty? Evaluating Predictive Uncertainty Under Dataset Shiftcited by 1,274
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 20234D Gaussian Splatting for Real-Time Dynamic Scene Renderingcited by 1,144
- 2023Deformable 3D Gaussians for High-Fidelity Monocular Dynamic Scene Reconstructioncited by 753
- 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
- 2023Dynamic 3D Gaussians: Tracking by Persistent Dynamic View Synthesiscited by 731
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 20244D Gaussian Splatting in the Wild with Uncertainty-Aware Regularization
- 2025Geo4D: Leveraging Video Generators for Geometric 4D Scene Reconstruction
- 2025Diff4Splat: Controllable 4D Scene Generation with Latent Dynamic Reconstruction Models
- 20264DGS-Fixer: Generative Sparse-View 4D Gaussian Splatting with Iterative Refinement Guided by Video Diffusion Priors
- 2023Make-It-4D: Synthesizing a Consistent Long-Term Dynamic Scene Video from a Single Image
- 2026Learning Global Motion with Compact Gaussians for Feed-Forward 4D Reconstruction
- 2026FreeOrbit4D: Training-Free Arbitrary Camera Redirection for Monocular Videos via Foreground-Complete 4D Reconstruction
- 2026Mesh4D: 4D Mesh Reconstruction and Tracking from Monocular Video