mlsanityData to 14 Oct 2026

FoundationGeo: Learning Spatial Pixel-Wise Fields for Monocular Metric Geometry

arXiv 2607.11588 ↗First posted 13 Jul 2026cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

We present FoundationGeo, a two-stage framework that explicitly bridges relative and metric prediction via spatial calibration and principled data design. Stage 1 learns a high-fidelity, affine-invariant geometry model by initializing with DINOv3 and training on a curated 10.2M-sample multi-domain corpus with complementary local-detail supervision, yielding sharp boundaries and strong cross-domain generalization. Stage 2 moves beyond global scaling by introducing lightweight pixel-wise calibration fields for metric estimation: a scale field for spatially varying metric alignment and a ray-direction correction field that mitigates directional bias in point-map geometry, together producing metrically consistent 3D point maps. Beyond model design, we identify camera intrinsic coverage, especially focal length distribution mismatch between training and test data, as a key bottleneck for zero-shot metric generalization: performance drops sharply when test intrinsics fall outside the training distribution. To address this, we synthesize additional training data across diverse focal lengths using a Blender-based data engine, repairing under-covered focal regimes and improving robustness under intrinsic shift. Extensive zero-shot evaluations across seven benchmarks show that FoundationGeo significantly strengthens cross-domain robustness, staying near the top across diverse domains while avoiding the sharp cross-domain performance drops observed in other methods. This consistency translates into the best overall performance, surpassing heavier baselines by over 5.2% on average.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 43 of its 51 references that are in the map. First posted on arXiv 13 Jul 2026.

Builds on

43 of 51 references.

References · 43

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  3. 2021Vision Transformers for Dense Predictioncited by 1,803
  4. 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
  5. 2024Depth Anything V2cited by 1,422
  6. 2025DINOv3cited by 1,414
  7. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  8. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  9. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  10. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
  11. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  12. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
31 more
  1. 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
  2. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  3. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  4. 2019BlendedMVS: A Large-scale Dataset for Generalized Multi-view Stereo Networkscited by 490
  5. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  6. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
  7. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
  8. 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
  9. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
  10. 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
  11. 2017Sparsity Invariant CNNscited by 326
  12. 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 299
  13. 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 286
  14. 2018DeepMVS: Learning Multi-view Stereopsiscited by 277
  15. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
  16. 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 240
  17. 2023MatrixCity: A Large-scale City Dataset for City-scale Neural Rendering and Beyondcited by 185
  18. 2025FoundationStereo: Zero-Shot Stereo Matchingcited by 173
  19. 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
  20. 2023Spring: A High-Resolution High-Detail Dataset and Benchmark for Scene Flow, Optical Flow and Stereocited by 172
  21. 2023DynamicStereo: Consistent Dynamic Depth from Stereo Videoscited by 148
  22. 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 138
  23. 20193D Ken Burns Effect from a Single Imagecited by 128
  24. 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
  25. 2025Pixel-Perfect Depth with Semantics-Prompted Diffusion Transformerscited by 51
  26. 2025Dens3R: A Foundation Model for 3D Geometry Predictioncited by 46
  27. 2023All for One, and One for All: UrbanSyn Dataset, the third Musketeer of Synthetic Driving Scenescited by 41
  28. 2020GeoNet++: Iterative Geometric Neural Network with Edge-Aware Refinement for Joint Depth and Surface Normal Estimationcited by 36
  29. 2023On the Importance of Accurate Geometry Data for Dense 3D Vision Taskscited by 26
  30. 2025MoRE: 3D Visual Geometry Reconstruction Meets Mixture-of-Expertscited by 21
  31. 2026Stabilizing Streaming Video Geometry via Dynamic Feature Normalizationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.