UniDAC: Universal Metric Depth Estimation for Any Camera
Not on the map. Why?
Abstract (arXiv)
Monocular metric depth estimation (MMDE) is a core challenge in computer vision, playing a pivotal role in real-world applications that demand accurate spatial understanding. Although prior works have shown promising zero-shot performance in MMDE, they often struggle with generalization across diverse camera types, such as fisheye and 360^circ cameras. Recent advances have addressed this through unified camera representations or canonical representation spaces, but they require either including large-FoV camera data during training or separately trained models for different domains. We propose UniDAC, an MMDE framework that presents universal robustness in all domains and generalizes across diverse cameras using a single model. We achieve this by decoupling metric depth estimation into relative depth prediction and spatially varying scale estimation, enabling robust performance across different domains. We propose a lightweight Depth-Guided Scale Estimation module that upsamples a coarse scale map to high resolution using the relative depth map as guidance to account for local scale variations. Furthermore, we introduce RoPE-φ, a distortion-aware positional embedding that respects the spatial warping in Equi-Rectangular Projections (ERP) via latitude-aware weighting. UniDAC achieves state of the art (SoTA) in cross-camera generalization by consistently outperforming prior methods across all datasets.
Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 58 of its 68 references that are in the map. First posted on arXiv 28 Mar 2026.
Builds on
58 of 68 references.
References · 58
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2016SGDR: Stochastic Gradient Descent with Warm Restartscited by 5,045
- 2021RoFormer: Enhanced Transformer with Rotary Position Embeddingcited by 4,703
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2021Vision Transformers for Dense Predictioncited by 1,803
- 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
- 2024Depth Anything V2cited by 1,422
- 2025DINOv3cited by 1,414
38 more
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,360
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2018Deformable ConvNets v2: More Deformable, Better Resultscited by 670
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
- 2020Hypersim: A Photorealistic Synthetic Dataset for Holistic Indoor Scene Understandingcited by 604
- 2020AdaBins: Depth Estimation using Adaptive Binscited by 601
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
- 2018Pseudo-LiDAR from Visual Depth Estimation: Bridging the Gap in 3D Object Detection for Autonomous Drivingcited by 457
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 395
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 382
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 382
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 365
- 2021Omnidata: A Scalable Pipeline for Making Multi-Task Mid-Level Vision Datasets from 3D Scanscited by 336
- 2024GeoWizard: Unleashing the Diffusion Priors for 3D Geometry Estimation from a Single Imagecited by 286
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2021Is Pseudo-Lidar needed for Monocular 3D Object detection?cited by 249
- 2020One Thousand and One Hours: Self-driving Motion Prediction Datasetcited by 240
- 2024Rotary Position Embedding for Vision Transformercited by 236
- 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 216
- 2020A2D2: Audi Autonomous Driving Datasetcited by 190
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 173
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 153
- 2018Evaluation of CNN-based Single-Image Depth Estimation Methodscited by 138
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 101
- 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 95
- 2021UniFuse: Unidirectional Fusion for 360circ Panorama Depth Estimationcited by 92
- 2025Marigold: Affordable Adaptation of Diffusion-Based Image Generators for Image Analysiscited by 78
- 2023iDisc: Internal Discretization for Monocular Depth Estimationcited by 73
- 2025UniK3D: Universal Camera Monocular 3D Estimationcited by 62
- 2022OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusioncited by 61
- 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
- 2021Towards Real-Time Monocular Depth Estimation for Robotics: A Surveycited by 57
- 2024Efficient Deformable ConvNets: Rethinking Dynamic and Sparse Operator for Vision Applicationscited by 50
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2026: 8.
8 papers.
- 2026X-Lens: Real-Time Metric Depth Estimation with Heterogeneous Camerascited by 3
- 2026DepthAgent: Towards Better Universal Depth Estimation via Sample-wise Expert Selectioncited by 1
- 2026The Road Ahead in Autonomous Driving: The KITScenes Multimodal Datasetcited by 1
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimationcited by 1
- 2026G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneitycited by 1
- 2026Geometric Distillation from Rectified Stereo: Leveraging Epipolar Cues for Monocular Depthcited by 0
- 2026Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Camerascited by 0
- 2026OmniAct3D: Leveraging Foundation Geometry and Evidence-Grounded Reasoning for Panoramic 3D Detectioncited by 0
- 2026OmniAct3D: Leveraging Foundation Geometry and Evidence-Grounded Reasoning for Panoramic 3D Detection2 Oct 2026
- 2026Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Cameras28 Sep 2026
- 2026G-ray: Ray-Level Relative Geometric Position Encoding in Multi-View Vision Transformers under Camera Heterogeneity14 Sep 2026
- 2026Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation8 Sep 2026
- 2026Geometric Distillation from Rectified Stereo: Leveraging Epipolar Cues for Monocular Depth17 Jul 2026
- 2026X-Lens: Real-Time Metric Depth Estimation with Heterogeneous Cameras14 Jul 2026
- 2026The Road Ahead in Autonomous Driving: The KITScenes Multimodal Dataset1 Jun 2026
- 2026DepthAgent: Towards Better Universal Depth Estimation via Sample-wise Expert Selection22 May 2026