OmniDepth: Dense Depth Estimation for Indoors Spherical Panoramas
Not on the map. Why?
Abstract (arXiv)
Recent work on depth estimation up to now has only focused on projective images ignoring 360 content which is now increasingly and more easily produced. We show that monocular depth estimation models trained on traditional images produce sub-optimal results on omnidirectional images, showcasing the need for training directly on 360 datasets, which however, are hard to acquire. In this work, we circumvent the challenges associated with acquiring high quality 360 datasets with ground truth depth annotations, by re-using recently released large scale 3D datasets and re-purposing them to 360 via rendering. This dataset, which is considerably larger than similar projective datasets, is publicly offered to the community to enable future research in this direction. We use this dataset to learn in an end-to-end fashion the task of depth estimation from 360 images. We show promising results in our synthesized data as well as in unseen realistic images.
Key facts. Cited by 98 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 12; 2022: 29; 2023: 11; 2024: 24; 2025: 10; 2026: 12.
98 papers.
Sort:
By area:
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
- 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 94
- 2021UniFuse: Unidirectional Fusion for 360circ Panorama Depth Estimationcited by 91
- 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
- 2022OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusioncited by 60
- 2021LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Renderingcited by 42
- 2022Review on Panoramic Imaging and Its Applications in Scene Understandingcited by 42
- 2023EGformer: Equirectangular Geometry-biased Transformer for 360 Depth Estimationcited by 42
- 2021ACDNet: Adaptively Combined Dilated Convolution for Monocular Panorama Depth Estimationcited by 39
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2024Depth Anywhere: Enhancing 360 Monocular Depth Estimation via Perspective Distillation and Unlabeled Data Augmentationcited by 38
- 2021Pano3D: A Holistic Benchmark and a Solid Baseline for 360o Depth Estimationcited by 37
38 more
- 2023HRDFuse: Monocular 360degDepth Estimation by Collaboratively Learning Holistic-with-Regional Depth Distributionscited by 37
- 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimationcited by 35
- 2024Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusioncited by 31
- 2022PanoFlow: Learning 360deg Optical Flow for Surrounding Temporal Understandingcited by 26
- 2022Multi-Modal Masked Pre-Training for Monocular Panoramic Depth Completioncited by 23
- 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Visioncited by 23
- 2025DA2: Depth Anything in Any Directioncited by 22
- 2024PanDA: Towards Panoramic Depth Anything with Unlabeled Panoramas and Mobius Spatial Augmentationcited by 21
- 2021Improving 360 Monocular Depth Estimation via Non-local Dense Prediction Transformer and Joint Supervised and Self-supervised Learningcited by 19
- 2023PanelNet: Understanding 360 Indoor Environment via Panel Representationcited by 19
- 2023PanoContext-Former: Panoramic Total Scene Understanding with a Transformercited by 19
- 2021Layout-Guided Novel View Synthesis from a Single Indoor Panoramacited by 16
- 2022GLPanoDepth: Global-to-Local Panoramic Depth Estimationcited by 16
- 2022360 Depth Estimation in the Wild -- The Depth360 Dataset and the SegFuse Networkcited by 15
- 2021PanoDR: Spherical Panorama Diminished Reality for Indoor Scenescited by 13
- 2022Complementary Bi-directional Feature Compression for Indoor 360deg Semantic Segmentation with Self-distillationcited by 12
- 2024SphereUFormer: A U-Shaped Transformer for Spherical 360 Perceptioncited by 12
- 2025PANORAMA: The Rise of Omnidirectional Vision in the Embodied AI Eracited by 12
- 2022A Survey on RGB-D Datasetscited by 11
- 2022FreDSNet: Joint Monocular Depth and Semantic Segmentation with Fast Fourier Convolutionscited by 11
- 20243D Scene Geometry Estimation from 360^circ Imagery: A Surveycited by 11
- 2022High-Resolution Depth Estimation for 360-degree Panoramas through Perspective and Panoramic Depth Images Registrationcited by 10
- 2023DarSwin: Distortion Aware Radial Swin Transformercited by 10
- 2022PanoDepth: A Two-Stage Approach for Monocular Omnidirectional Depth Estimationcited by 9
- 2024SGFormer: Spherical Geometry Transformer for 360 Depth Estimationcited by 9
- 2024RomniStereo: Recurrent Omnidirectional Stereo Matchingcited by 8
- 2024FoVA-Depth: Field-of-View Agnostic Depth Estimation for Cross-Dataset Generalizationcited by 8
- 2024FisheyeDepth: A Real Scale Self-Supervised Depth Estimation Model for Fisheye Cameracited by 8
- 2021Single-Shot Cuboids: Geodesics-based End-to-end Manhattan Aligned Layout Estimation from Spherical Panoramascited by 7
- 2021360deg Optical Flow using Tangent Imagescited by 7
- 2022Distortion-Tolerant Monocular Depth Estimation On Omnidirectional Images Using Dual-cubemapcited by 7
- 20233D reconstruction from spherical images: A review of techniques, applications, and prospectscited by 7
- 2025EDM: Equirectangular Projection-Oriented Dense Kernelized Feature Matchingcited by 7
- 2025PanoSplatt3R: Leveraging Perspective Pretraining for Generalized Unposed Wide-Baseline Panorama Reconstructioncited by 7
- 2026Holo360D: A Large-Scale Real-World Dataset with Continuous Trajectories for Advancing Panoramic 3D Reconstruction and Beyondcited by 7
- 2021Pseudocylindrical Convolutions for Learned Omnidirectional Image Compressioncited by 6
- 2022HiMODE: A Hybrid Monocular Omnidirectional Depth Estimation Modelcited by 6
- 2022SphereDepth: Panorama Depth Estimation from Spherical Domaincited by 6
50 most cited of 98 All 98 (JSON)
- 2026Decoupling Spherical Reasoning from Dense Prediction for 360 Depth Estimation30 Sep 2026
- 2026RoomLight: A 2.5D Illumination Prior for Indoor Environments23 Sep 2026
- 2026FastPano3D: Feed-Forward Indoor Panoramic 3D Reconstruction from a Single Image29 Jun 2026
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modeling26 Jun 2026
- 2026Spherical-to-ERP Epipolar Rectification for Single-Axis Disparity in 360 Stereo23 Jun 2026
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Images10 Jun 2026
- 2026Pantheon360: Taming Digital Twin Generation via 3D-Aware 360deg Video Diffusion25 May 2026
- 2026Sphere-Depth: A Benchmark for Depth Estimation Methods with Varying Spherical Camera Orientations25 Apr 2026
- 2026Holo360D: A Large-Scale Real-World Dataset with Continuous Trajectories for Advancing Panoramic 3D Reconstruction and Beyond24 Apr 2026
- 2026FullCircle: Effortless 3D Reconstruction from Casual 360^circ Captures23 Mar 2026
- 2026Fly360: Omnidirectional Obstacle Avoidance within Drone View6 Mar 2026
- 2026Cross360: 360deg Monocular Depth Estimation via Cross Projections Across Scales24 Jan 2026
38 more
- 2025Depth Anything in 360^circ: Towards Scale Invariance in the Wild28 Dec 2025
- 2025PAGCNet: A Pose-Aware and Geometry Constrained Framework for Panoramic Depth Estimation9 Oct 2025
- 2025DA2: Depth Anything in Any Direction30 Sep 2025
- 2025RPG360: Robust 360 Depth Estimation with Perspective Foundation Models and Graph Optimization28 Sep 2025
- 2025PANORAMA: The Rise of Omnidirectional Vision in the Embodied AI Era16 Sep 2025
- 2025PanoSplatt3R: Leveraging Perspective Pretraining for Generalized Unposed Wide-Baseline Panorama Reconstruction29 Jul 2025
- 2025OB3D: A New Dataset for Benchmarking Omnidirectional 3D Reconstruction Using Blender26 May 2025
- 2025EDM: Equirectangular Projection-Oriented Dense Kernelized Feature Matching28 Feb 2025
- 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Vision11 Feb 2025
- 2025SphereFusion: Efficient Panorama Depth Estimation via Gated Fusion9 Feb 2025
- 2024SphereUFormer: A U-Shaped Transformer for Spherical 360 Perception9 Dec 2024
- 2024Multi-task Geometric Estimation of Depth and Surface Normal from Monocular 360deg Images4 Nov 2024
- 2024MultiDepth: Multi-Sample Priors for Refining Monocular Metric Depth Estimations in Indoor Scenes1 Nov 2024
- 2024CUBE360: Learning Cubic Field Representation for Monocular 360 Depth Estimation for Virtual Reality8 Oct 2024
- 2024FisheyeDepth: A Real Scale Self-Supervised Depth Estimation Model for Fisheye Camera23 Sep 2024
- 2024Robust and Flexible Omnidirectional Depth Estimation with Multiple 360-degree Cameras23 Sep 2024
- 2024Revisiting 360 Depth Estimation with PanoGabor: A New Fusion Perspective29 Aug 2024
- 2024Elite360M: Efficient 360 Multi-task Learning via Bi-projection Fusion and Cross-task Collaboration18 Aug 2024
- 2024MCPDepth: Omnidirectional Depth Estimation via Stereo Matching from Multi-Cylindrical Panoramas3 Aug 2024
- 2024360 in the Wild: Dataset for Depth Prediction and View Synthesis27 Jun 2024
- 2024PanDA: Towards Panoramic Depth Anything with Unlabeled Panoramas and Mobius Spatial Augmentation19 Jun 2024
- 2024Depth Anywhere: Enhancing 360 Monocular Depth Estimation via Perspective Distillation and Unlabeled Data Augmentation18 Jun 2024
- 2024PanoNormal: Monocular Indoor 360deg Surface Normal Estimation29 May 2024
- 2024Estimating Depth of Monocular Panoramic Image with Teacher-Student Model Fusing Equirectangular and Spherical Representations27 May 2024
- 2024CRF360D: Monocular 360 Depth Estimation via Spherical Fully-Connected CRFs19 May 2024
- 2024SGFormer: Spherical Geometry Transformer for 360 Depth Estimation23 Apr 2024
- 2024OmniLocalRF: Omnidirectional Local Radiance Fields from Dynamic Videos31 Mar 2024
- 2024MaGRITTe: Manipulative and Generative 3D Realization from Image, Topview and Text30 Mar 2024
- 2024Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusion25 Mar 2024
- 2024Convolution kernel adaptation to calibrated fisheye2 Feb 2024
- 2024FoVA-Depth: Field-of-View Agnostic Depth Estimation for Cross-Dataset Generalization24 Jan 2024
- 20243D Scene Geometry Estimation from 360^circ Imagery: A Survey17 Jan 2024
- 2024RomniStereo: Recurrent Omnidirectional Stereo Matching9 Jan 2024
- 2024See360: Novel Panoramic View Interpolation7 Jan 2024
- 2023Calibrating Panoramic Depth Estimation for Practical Localization and Mapping27 Aug 2023
- 2023Enhancing Perception and Immersion in Pre-Captured Environments through Learning-Based Eye Height Adaptation24 Aug 2023
- 2023PanoContext-Former: Panoramic Total Scene Understanding with a Transformer21 May 2023
- 2023PanelNet: Understanding 360 Indoor Environment via Panel Representation16 May 2023
50 newest of 98 All 98 (JSON)
- 2022NeW CRFs: Neural Window Fully-connected CRFs for Monocular Depth Estimationcited by 151
- 2022PanoFormer: Panorama Transformer for Indoor 360 Depth Estimationcited by 94
- 2021UniFuse: Unidirectional Fusion for 360circ Panorama Depth Estimationcited by 91
- 2021360MonoDepth: High-Resolution 360deg Monocular Depth Estimationcited by 60
- 2022OmniFusion: 360 Monocular Depth Estimation via Geometry-Aware Fusioncited by 60
- 2021LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Renderingcited by 42
- 2022Review on Panoramic Imaging and Its Applications in Scene Understandingcited by 42
- 2023EGformer: Equirectangular Geometry-biased Transformer for 360 Depth Estimationcited by 42
- 2021ACDNet: Adaptively Combined Dilated Convolution for Monocular Panorama Depth Estimationcited by 39
- 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
- 2024Depth Anywhere: Enhancing 360 Monocular Depth Estimation via Perspective Distillation and Unlabeled Data Augmentationcited by 38
- 2021Pano3D: A Holistic Benchmark and a Solid Baseline for 360o Depth Estimationcited by 37
12 most cited of 97 All 97 (JSON)
- 2026Decoupling Spherical Reasoning from Dense Prediction for 360 Depth Estimation30 Sep 2026
- 2026RoomLight: A 2.5D Illumination Prior for Indoor Environments23 Sep 2026
- 2026FastPano3D: Feed-Forward Indoor Panoramic 3D Reconstruction from a Single Image29 Jun 2026
- 2026Panoramic Scene Understanding: A Survey from Distortion-Aware Engineering to Sphere-Native Modeling26 Jun 2026
- 2026Spherical-to-ERP Epipolar Rectification for Single-Axis Disparity in 360 Stereo23 Jun 2026
- 2026DepthMaster: Unified Monocular Depth Estimation for Perspective and Panoramic Images10 Jun 2026
- 2026Sphere-Depth: A Benchmark for Depth Estimation Methods with Varying Spherical Camera Orientations25 Apr 2026
- 2026Holo360D: A Large-Scale Real-World Dataset with Continuous Trajectories for Advancing Panoramic 3D Reconstruction and Beyond24 Apr 2026
- 2026FullCircle: Effortless 3D Reconstruction from Casual 360^circ Captures23 Mar 2026
- 2026Fly360: Omnidirectional Obstacle Avoidance within Drone View6 Mar 2026
- 2026Cross360: 360deg Monocular Depth Estimation via Cross Projections Across Scales24 Jan 2026
- 2025Depth Anything in 360^circ: Towards Scale Invariance in the Wild28 Dec 2025
12 newest of 97 All 97 (JSON)