UniMetric: Universal Metric Scale Recovery for Visual Geometry Foundation Models
Not on the map. Why?
Abstract (arXiv)
Recent advances in multimodal foundation models, exemplified by GPT-6 Astra, raise the prospect of general-purpose embodied reasoning and planning. Using Internet videos for embodied pretraining calls for reliable physical-scale annotations. Yet visual geometry foundation models often recover scene structure and camera motion without reliable metric scale. We show that uncertain size priors of familiar objects can jointly constrain a reconstruction's shared scale. Building on this insight, we present UniMetric, a universal and training-free metric scale recovery framework for geometry foundation models, without additional sensors or task-specific metric supervision. Specifically, Metric Prior Acquisition elicits object height intervals from a vision-language model. Semantic-Geometric Alignment measures reconstructed object heights along the estimated support-surface normal in each frame and converts the priors into scale intervals. Global Scale Recovery reconciles these intervals through a convex objective, yielding a jointly feasible scale when they overlap and a unique compromise otherwise. The estimated sequence-level scale is applied uniformly to reconstructed points and camera translations. Controlled experiments with real VLM priors show that combining observations improves scale accuracy with exact relative object heights. To evaluate metric accuracy on GFM reconstructions without ground-truth scale alignment, we introduce MetricBench, covering twelve embodied, driving, and roadside subsets with sensor-derived ground truth. Across nine geometry foundation models, UniMetric reduces mean depth Abs Rel, reconstruction Chamfer distance, and trajectory error by 54.2%, 83.8%, and 65.6%, respectively, improving every model on all three tasks at the suite level. We release the UniMetric code and MetricBench data.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 49 references that are in the map. First posted on arXiv 12 Oct 2026.
Builds on
40 of 49 references.
References · 40
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
- 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,539
- 2024Depth Anything V2cited by 1,422
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2020ORB-SLAM3: An Accurate Open-Source Library for Visual, Visual-Inertial and Multi-Map SLAMcited by 878
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
- 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 657
28 more
- 2017VINS-Mono: A Robust and Versatile Monocular Visual-Inertial State Estimatorcited by 423
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2025π3: Permutation-Equivariant Visual Geometry Learningcited by 319
- 2025MapAnything: Universal Feed-Forward Metric 3D Reconstructioncited by 314
- 2022DAIR-V2X: A Large-Scale Dataset for Vehicle-Infrastructure Cooperative 3D Object Detectioncited by 273
- 2025Video Depth Anything: Consistent Depth Estimation for Super-Long Videoscited by 207
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2025STream3R: Scalable Sequential 3D Reconstruction with Causal Transformercited by 82
- 2023BEVHeight: A Robust Framework for Vision-based Roadside 3D Object Detectioncited by 75
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 50
- 2026LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstructioncited by 37
- 2026Scal3R: Scalable Test-Time Training for Large-Scale 3D Reconstructioncited by 31
- 2023BEVHeight++: Toward Robust Visual Centric 3D Object Detectioncited by 30
- 2025Humanoid Everyday: A Comprehensive Robotic Dataset for Open-World Humanoid Manipulationcited by 25
- 2023MonoGAE: Roadside Monocular 3D Object Detection with Ground-Aware Embeddingscited by 22
- 2024V2X-Radar: A Multi-modal Dataset with 4D Radar for Cooperative Perceptioncited by 22
- 20264RC: 4D Reconstruction via Conditional Querying Anytime and Anywherecited by 22
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 21
- 2022FusionPortable: A Multi-Sensor Campus-Scene Dataset for Evaluation of Localization and Mapping Accuracy on Diverse Platformscited by 15
- 20253EED: Ground Everything Everywhere in 3Dcited by 12
- 2026In-Context Robot Learning with VLM Agentscited by 8
- 2024CEAR: Comprehensive Event Camera Dataset for Rapid Perception of Agile Quadruped Robotscited by 7
- 2021Accurate and Robust Scale Recovery for Monocular Visual Odometry Based on Plane Geometrycited by 6
- 2026D'ej`a View: Looping Transformers for Multi-View 3D Reconstructioncited by 6
- 2017Probabilistic Global Scale Estimation for MonoSLAM Based on Generic Object Detectioncited by 3
- 2026VIDAR: Visual-Inertial Dense Alignment and Reconstruction via a Geometric Foundation Modelcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Beyond Relative Geometry: Metric-Aware Geometry Perception for Robotics ↗
- 2026Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Models
- 2026Teaching Vision-Language Models to Use the Scale They Are Given: Label-Free Equivariance Training for Metric Physical Reasoning
- 2025MetricHMSR:Metric Human Mesh and Scene Recovery from Monocular Images
- 2026MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources
- 2026Understanding the Impact of Geometric Foundation Models on Vision-Language-Action Models
- 2026Geometry-Preserving Unsupervised Alignment for Heterogeneous Foundation Models
- 2026Geometry Matters: 3D Foundation Priors for Learning Semantic Correspondence