Depth Any Panoramas: A Foundation Model for Panoramic Depth Estimation
Not on the map. Why?
Abstract (arXiv)
In this work, we present a panoramic metric depth foundation model that generalizes across diverse scene distances. We explore a data-in-the-loop paradigm from the view of both data construction and framework design. We collect a large-scale dataset by combining public datasets, high-quality synthetic data from our UE5 simulator and text-to-image models, and real panoramic images from the web. To reduce domain gaps between indoor/outdoor and synthetic/real data, we introduce a three-stage pseudo-label curation pipeline to generate reliable ground truth for unlabeled images. For the model, we adopt DINOv3-Large as the backbone for its strong pre-trained generalization, and introduce a plug-and-play range mask head, sharpness-centric optimization, and geometry-centric optimization to improve robustness to varying distances and enforce geometric consistency across views. Experiments on multiple benchmarks (e.g., Stanford2D3D, Matterport3D, and Deep360) demonstrate strong performance and zero-shot generalization, with particularly robust and stable metric predictions in diverse real-world scenes. The project page can be found at: hrefhttps://insta360-research-team.github.io/DAPwebsite/ https://insta360-research-team.github.io/DAPwebsite/
Key facts. Cited by 24 papers in the map (data through 7 Oct 2026). Builds on 42 of its 50 references that are in the map. First posted on arXiv 18 Dec 2025.
Builds on
42 of 50 references.
References · 42
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Depth Anything V2cited by 1,385
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2025DINOv3cited by 1,297
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 404
- 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
- 2024Metric3Dv2: A Versatile Monocular Geometric Foundation Model for Zero-shot Metric Depth and Surface Normal Estimationcited by 389
30 more
- 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
- 2023Metric3D: Towards Zero-shot Metric 3D Prediction from A Single Imagecited by 357
- 2024MoGe: Unlocking Accurate Monocular Geometry Estimation for Open-Domain Images with Optimal Training Supervisioncited by 290
- 2019Structured3D: A Large Photo-realistic Dataset for Structured 3D Modelingcited by 285
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 250
- 2025UniDepthV2: Universal Monocular Metric Depth Estimation Made Simplercited by 170
- 2024Lotus: Diffusion-based Visual Foundation Model for High-quality Dense Predictioncited by 163
- 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 94
- 2021UniFuse: Unidirectional Fusion for 360circ Panorama Depth Estimationcited by 91
- 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
- 2022OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusioncited by 60
- 2025UniK3D: Universal Camera Monocular 3D Estimationcited by 60
- 2023EGformer: Equirectangular Geometry-biased Transformer for 360 Depth Estimationcited by 42
- 2021ACDNet: Adaptively Combined Dilated Convolution for Monocular Panorama Depth Estimationcited by 39
- 2024Depth Anywhere: Enhancing 360 Monocular Depth Estimation via Perspective Distillation and Unlabeled Data Augmentationcited by 38
- 2025Depth Any Camera: Zero-Shot Metric Depth Estimation from Any Cameracited by 38
- 2023HRDFuse: Monocular 360degDepth Estimation by Collaboratively Learning Holistic-with-Regional Depth Distributionscited by 37
- 2024Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusioncited by 31
- 2025DiT360: High-Fidelity Panoramic Image Generation via Hybrid Trainingcited by 24
- 2025One Flight Over the Gap: A Survey from Perspective to Panoramic Visioncited by 23
- 2025DA2: Depth Anything in Any Directioncited by 22
- 2024PanDA: Towards Panoramic Depth Anything with Unlabeled Panoramas and Mobius Spatial Augmentationcited by 21
- 2025Jasmine: Harnessing Diffusion Prior for Self-supervised Depth Estimationcited by 20
- 2022GLPanoDepth: Global-to-Local Panoramic Depth Estimationcited by 16
- 2024SphereUFormer: A U-Shaped Transformer for Spherical 360 Perceptioncited by 12
- 2025AirSim360: A Panoramic Simulation Platform within Drone Viewcited by 12
- 2022High-Resolution Depth Estimation for 360-degree Panoramas through Perspective and Panoramic Depth Images Registrationcited by 10
- 2025StereoDiff: Stereo-Diffusion Synergy for Video Depth Estimationcited by 6
- 2024Revisiting 360 Depth Estimation with PanoGabor: A New Fusion Perspectivecited by 5
- 2024Elite360M: Efficient 360 Multi-task Learning via Bi-projection Fusion and Cross-task Collaborationcited by 3
Built on by
Citing papers per year: 2026: 24.
24 papers.
Sort:
By area:
- 2026OmniRoam: World Wandering via Long-Horizon Panoramic Video Generationcited by 15
- 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environmentscited by 10
- 2026MTPano: Multi-Task Panoramic Scene Understanding via Label-Free Integration of Dense Prediction Priorscited by 5
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama Worldcited by 5
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creationcited by 4
- 2026X-Lens: Real-Time Metric Depth Estimation with Heterogeneous Camerascited by 3
- 2026Fly360: Omnidirectional Obstacle Avoidance within Drone Viewcited by 2
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modelingcited by 2
- 2026PanoWorld: A Generative Spatial World Model for Consistent Whole-House Panorama Synthesiscited by 2
- 2026UniSHARP: Universal Sharp Monocular View Synthesiscited by 2
- 2026AerialMetric: Benchmarking and Adapting UAV Monocular Metric Depth Estimation in the Real Worldcited by 2
- 2026Unified Panoramic Geometry Estimation via Multi-View Foundation Modelscited by 1
12 more
- 2026Argus: Metric Panoramic 3D Reconstruction for Indoor Scenescited by 1
- 2026H-OmniStereo: Zero-Shot Omnidirectional Stereo Matching with Heading-Aligned Normal Priorscited by 0
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Imagescited by 0
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modelingcited by 0
- 2026Enhancing In-context Panoramic Generation via Geometric-aware Pretrainingcited by 0
- 2026Geometry and Gradient-based Partitioning for Panoramic Outdoor Reconstructioncited by 0
- 2026More Than Where You Are: Learning Semantics, Structure, and Geometry from Cross-View Localizationcited by 0
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunitiescited by 0
- 2026PanoFuse: Panorama-Enhanced Vision-Language-Action Learning with Decoupled Semantic-Geometric Routingcited by 0
- 2026PanoVLN: Towards Effective Panoramic Vision-and-Language Navigationcited by 0
- 2026Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Camerascited by 0
- 2026EPIC: Epipolar-Consistent 360deg Immersive Stereo Video Generationcited by 0
- 2026EPIC: Epipolar-Consistent 360deg Immersive Stereo Video Generation30 Sep 2026
- 2026Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Cameras28 Sep 2026
- 2026PanoVLN: Towards Effective Panoramic Vision-and-Language Navigation28 Sep 2026
- 2026PanoFuse: Panorama-Enhanced Vision-Language-Action Learning with Decoupled Semantic-Geometric Routing21 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026X-Lens: Real-Time Metric Depth Estimation with Heterogeneous Cameras14 Jul 2026
- 2026More Than Where You Are: Learning Semantics, Structure, and Geometry from Cross-View Localization14 Jul 2026
- 2026Geometry and Gradient-based Partitioning for Panoramic Outdoor Reconstruction9 Jul 2026
- 2026Enhancing In-context Panoramic Generation via Geometric-aware Pretraining9 Jul 2026
- 2026SimWorlds: A Multi-Agent System for Dynamic 3D Scene Creation2 Jul 2026
- 2026Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes29 Jun 2026
- 2026AerialMetric: Benchmarking and Adapting UAV Monocular Metric Depth Estimation in the Real World29 Jun 2026
12 more
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modeling26 Jun 2026
- 2026MemoBench: Benchmarking World Modeling in Dynamically Changing Environments25 Jun 2026
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Images10 Jun 2026
- 2026UniSHARP: Universal Sharp Monocular View Synthesis5 Jun 2026
- 2026Unified Panoramic Geometry Estimation via Multi-View Foundation Models25 May 2026
- 2026PanoWorld: A Generative Spatial World Model for Consistent Whole-House Panorama Synthesis18 May 2026
- 2026PanoWorld: Geometry-Consistent Panoramic Video World Modeling14 May 2026
- 2026H-OmniStereo: Zero-Shot Omnidirectional Stereo Matching with Heading-Aligned Normal Priors14 May 2026
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama World13 May 2026
- 2026OmniRoam: World Wandering via Long-Horizon Panoramic Video Generation31 Mar 2026
- 2026Fly360: Omnidirectional Obstacle Avoidance within Drone View6 Mar 2026
- 2026MTPano: Multi-Task Panoramic Scene Understanding via Label-Free Integration of Dense Prediction Priors5 Feb 2026
- 2026OmniRoam: World Wandering via Long-Horizon Panoramic Video Generationcited by 15
- 2026MTPano: Multi-Task Panoramic Scene Understanding via Label-Free Integration of Dense Prediction Priorscited by 5
- 2026PanoWorld: Towards Spatial Supersensing in 360^circ Panorama Worldcited by 5
- 2026X-Lens: Real-Time Metric Depth Estimation with Heterogeneous Camerascited by 3
- 2026Fly360: Omnidirectional Obstacle Avoidance within Drone Viewcited by 2
- 2026UniSHARP: Universal Sharp Monocular View Synthesiscited by 2
- 2026AerialMetric: Benchmarking and Adapting UAV Monocular Metric Depth Estimation in the Real Worldcited by 2
- 2026Unified Panoramic Geometry Estimation via Multi-View Foundation Modelscited by 1
- 2026Argus: Metric Panoramic 3D Reconstruction for Indoor Scenescited by 1
- 2026H-OmniStereo: Zero-Shot Omnidirectional Stereo Matching with Heading-Aligned Normal Priorscited by 0
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Imagescited by 0
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modelingcited by 0
12 most cited of 18 All 18 (JSON)
- 2026EPIC: Epipolar-Consistent 360deg Immersive Stereo Video Generation30 Sep 2026
- 2026Many Eyes, One World: Feed-Forward 3D Reconstruction from Mixed Cameras28 Sep 2026
- 2026Monocular Depth Estimation from a Single Image: Progress and Opportunities1 Sep 2026
- 2026X-Lens: Real-Time Metric Depth Estimation with Heterogeneous Cameras14 Jul 2026
- 2026More Than Where You Are: Learning Semantics, Structure, and Geometry from Cross-View Localization14 Jul 2026
- 2026Geometry and Gradient-based Partitioning for Panoramic Outdoor Reconstruction9 Jul 2026
- 2026Enhancing In-context Panoramic Generation via Geometric-aware Pretraining9 Jul 2026
- 2026Argus: Metric Panoramic 3D Reconstruction for Indoor Scenes29 Jun 2026
- 2026AerialMetric: Benchmarking and Adapting UAV Monocular Metric Depth Estimation in the Real World29 Jun 2026
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modeling26 Jun 2026
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Images10 Jun 2026
- 2026UniSHARP: Universal Sharp Monocular View Synthesis5 Jun 2026
12 newest of 18 All 18 (JSON)