mlsanityData to 14 Oct 2026

MetricAnything: Scaling Metric Depth Pretraining with Noisy Heterogeneous Sources

arXiv 2601.22054 ↗First posted 29 Jan 2026cs.CV cs.AIcited by 10

Not on the map. Why?

Abstract (arXiv)

Scaling has powered recent advances in vision foundation models, yet extending this paradigm to metric depth estimation remains challenging due to heterogeneous sensor noise, camera-dependent biases, and metric ambiguity in noisy cross-source 3D data. We introduce Metric Anything, a simple and scalable pretraining framework that learns metric depth from noisy, diverse 3D sources without manually engineered prompts, camera-specific modeling, or task-specific architectures. Central to our approach is the Sparse Metric Prompt, created by randomly masking depth maps, which serves as a universal interface that decouples spatial reasoning from sensor and camera biases. Using about 20M image-depth pairs spanning reconstructed, captured, and rendered 3D data across 10000 camera models, we demonstrate-for the first time-a clear scaling trend in the metric depth track. The pretrained model excels at prompt-driven tasks such as depth completion, super-resolution and Radar-camera fusion, while its distilled prompt-free student achieves state-of-the-art results on monocular depth estimation, camera intrinsics recovery, single/multi-view metric 3D reconstruction, and VLA planning. We also show that using pretrained ViT of Metric Anything as a visual encoder significantly boosts Multimodal Large Language Model capabilities in spatial intelligence. These results show that metric depth estimation can benefit from the same scaling laws that drive modern foundation models, establishing a new path toward scalable and efficient real-world metric perception. We open-source MetricAnything at http://metric-anything.github.io/metric-anything-io/ to support community research.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 109 of its 134 references that are in the map. First posted on arXiv 29 Jan 2026.

Builds on

109 of 134 references.

References · 109

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2023Segment Anythingcited by 8,234
  6. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  7. 2022Scalable Diffusion Models with Transformerscited by 6,054
  8. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  9. 2024GPT-4o System Cardcited by 4,588
  10. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  11. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
  12. 2021Zero-Shot Text-to-Image Generationcited by 4,288
38 more
  1. 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
  2. 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
  3. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  5. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  6. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  7. 2019Scalability in Perception for Autonomous Driving: Waymo Open Datasetcited by 2,451
  8. 2021Vision Transformers for Dense Predictioncited by 1,803
  9. 2023DUSt3R: Geometric 3D Vision Made Easycited by 1,567
  10. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  11. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  12. 2024Depth Anything V2cited by 1,422
  13. 2025DINOv3cited by 1,414
  14. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  15. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  16. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
  17. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
  18. 2024Grounding Image Matching in 3D with MASt3Rcited by 983
  19. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 904
  20. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 737
  21. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
  22. 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
  23. 2023VILA: On Pre-training for Visual Language Modelscited by 692
  24. 2025Depth Anything 3: Recovering the Visual Space from Any Viewscited by 692
  25. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  26. 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
  27. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  28. 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
  29. 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
  30. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  31. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  32. 2024Long Context Transfer from Language to Visioncited by 515
  33. 2020TartanAir: A Dataset to Push the Limits of Visual SLAMcited by 506
  34. 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
  35. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  36. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  37. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
  38. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 404

50 most cited of 109 All 109 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024MetricGold: Leveraging Text-To-Image Latent Diffusion Models for Metric Depth Estimation
  2. 2024SharpDepth: Sharpening Metric Depth Predictions Using Diffusion Distillation
  3. 2025GeoDiff: Geometry-Guided Diffusion for Metric Depth Estimation
  4. 2024GRIN: Zero-Shot Metric Depth with Pixel-Level Diffusion
  5. 2025MetricHMSR:Metric Human Mesh and Scene Recovery from Monocular Images
  6. 2026Unlocking Dense Metric Depth Estimation in VLMs
  7. 2022SelfTune: Metrically Scaled Monocular Depth Estimation through Self-Supervised Learning
  8. 2026Seeing Is Not Measuring: Tool-Augmented Metric Spatial Reasoning for Vision-Language Models