mlsanityData to 7 Oct 2026

360MonoDepth: High-Resolution 360deg Monocular Depth Estimation

arXiv 2111.15669 ↗First posted 30 Nov 2021cs.CVcited by 60

Not on the map. Why?

Abstract (arXiv)

360deg cameras can capture complete environments in a single shot, which makes 360deg imagery alluring in many computer vision tasks. However, monocular depth estimation remains a challenge for 360deg data, particularly for high resolutions like 2K (2048x1024) and beyond that are important for novel-view synthesis and virtual reality applications. Current CNN-based methods do not support such high resolutions due to limited GPU memory. In this work, we propose a flexible framework for monocular depth estimation from high-resolution 360deg images using tangent images. We project the 360deg input image onto a set of tangent planes that produce perspective views, which are suitable for the latest, most accurate state-of-the-art perspective monocular depth estimators. To achieve globally consistent disparity estimates, we recombine the individual depth estimates using deformable multi-scale alignment followed by gradient-domain blending. The result is a dense, high-resolution 360deg depth map with a high level of detail, also for outdoor scenes which are not supported by existing methods. Our source code and data are available at https://manurare.github.io/360monodepth/.

Key facts. Cited by 60 papers in the map (data through 7 Oct 2026). Builds on 53 of its 89 references that are in the map. First posted on arXiv 30 Nov 2021.

Builds on

53 of 89 references.

References · 53

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2021Vision Transformers for Dense Predictioncited by 1,789
  4. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,484
  5. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,354
  6. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  7. 2019The Replica Dataset: A Digital Replica of Indoor Spacescited by 885
  8. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  9. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
  10. 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
  11. 2018MegaDepth: Learning Single-View Depth Prediction from Internet Photoscited by 731
  12. 2018Spherical CNNscited by 452
38 more
  1. 2021Dynamic View Synthesis from Dynamic Monocular Videocited by 420
  2. 2017Joint 2D-3D-Semantic Data for Indoor Scene Understandingcited by 404
  3. 2016Deeper Depth Prediction with Fully Convolutional Residual Networkscited by 402
  4. 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
  5. 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 262
  6. 2017Learning SO(3) Equivariant Representations with Spherical CNNscited by 244
  7. 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
  8. 2020Learning to Recover 3D Scene Shape from a Single Imagecited by 214
  9. 20203D Photography using Context-aware Layered Depth Inpaintingcited by 206
  10. 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
  11. 2019Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Camerascited by 170
  12. 2018Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstructioncited by 159
  13. 2017Learning Depth from Monocular Videos using Direct Methodscited by 154
  14. 2019Learning the Depths of Moving People by Watching Frozen Peoplecited by 120
  15. 2020HoHoNet: 360 Indoor Holistic Understanding with Latent Horizontal Featurescited by 104
  16. 2021Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Mergingcited by 104
  17. 2018Every Pixel Counts ++: Joint Learning of Geometry and Motion with 3D Holistic Understandingcited by 101
  18. 2018OmniDepth: Dense Depth Estimation for Indoors Spherical Panoramascited by 98
  19. 2021UniFuse: Unidirectional Fusion for 360circ Panorama Depth Estimationcited by 91
  20. 2019Tangent Images for Mitigating Spherical Distortioncited by 79
  21. 2019Web Stereo Video Supervision for Depth Prediction from Dynamic Scenescited by 73
  22. 2018Cube Padding for Weakly-Supervised Saliency Prediction in 360deg Videoscited by 66
  23. 2019OpenVSLAM: A Versatile Visual SLAM Frameworkcited by 64
  24. 2020MatryODShka: Real-time 6DoF Video View Synthesis using Multi-Sphere Imagescited by 64
  25. 2019DepthTransfer: Depth Extraction from Video Using Non-parametric Samplingcited by 60
  26. 2018Kernel Transformer Networks for Compact Spherical Convolutioncited by 56
  27. 2019Corners for Layout: End-to-End Layout Recovery from 360 Imagescited by 55
  28. 2019Orientation-aware Semantic Segmentation on Icosahedron Spherescited by 52
  29. 2019Spherical View Synthesis for Self-Supervised 360 Depth Estimationcited by 51
  30. 2020One Shot 3D Photographycited by 45
  31. 2021LED2-Net: Monocular 360 Layout Estimation via Differentiable Depth Renderingcited by 42
  32. 2018Self-Supervised Learning of Depth and Camera Motion from 360deg Videoscited by 40
  33. 2018SpherePHD: Applying CNNs on a Spherical PolyHeDron Representation of 360 degree Imagescited by 40
  34. 2019360SD-Net: 360deg Stereo Depth Estimation with Learnable Cost Volumecited by 40
  35. 2018Single View Stereo Matchingcited by 39
  36. 2018Eliminating the Blind Spot: Adapting 3D Object Detection and Monocular Depth Estimation to 360deg Panoramic Imagerycited by 34
  37. 2019Pano Popups: Indoor 3D Reconstruction with a Plane-Aware Networkcited by 25
  38. 2017Aperture Supervision for Monocular Depth Estimationcited by 21

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 4; 2023: 12; 2024: 20; 2025: 15; 2026: 9.

60 papers.

Sort:

By area:

  1. 2023Text2Room: Extracting Textured 3D Meshes from 2D Text-to-Image Modelscited by 245
  2. 2024DreamScene360: Unconstrained Text-to-3D Scene Generation with Panoramic Gaussian Splattingcited by 81
  3. 2024LayerPano3D: Layered 3D Panorama for Hyper-Immersive Scene Generationcited by 53
  4. 2023PERF: Panoramic Neural Radiance Field from a Single Panoramacited by 45
  5. 2022Review on Panoramic Imaging and Its Applications in Scene Understandingcited by 42
  6. 2023PatchFusion: An End-to-End Tile-Based Framework for High-Resolution Monocular Metric Depth Estimationcited by 39
  7. 2022Deep Learning for Omnidirectional Vision: A Survey and New Perspectivescited by 38
  8. 2024Depth Anywhere: Enhancing 360 Monocular Depth Estimation via Perspective Distillation and Unlabeled Data Augmentationcited by 38
  9. 2025Depth Any Camera: Zero-Shot Metric Depth Estimation from Any Cameracited by 38
  10. 2023HRDFuse: Monocular 360degDepth Estimation by Collaboratively Learning Holistic-with-Regional Depth Distributionscited by 37
  11. 2024Elite360D: Towards Efficient 360 Depth Estimation via Semantic- and Distance-Aware Bi-Projection Fusioncited by 31
  12. 2024Imagine360: Immersive 360 Video Generation from Perspective Anchorcited by 27
38 more
  1. 2024SyncTweedies: A General Generative Framework Based on Synchronized Diffusionscited by 26
  2. 2024HoloDreamer: Holistic 3D Panoramic World Generation from Text Descriptionscited by 24
  3. 2025Depth Any Panoramas: A Foundation Model for Panoramic Depth Estimationcited by 24
  4. 2022Multi-Modal Masked Pre-Training for Monocular Panoramic Depth Completioncited by 23
  5. 2025A Survey of Representation Learning, Optimization Strategies, and Applications for Omnidirectional Visioncited by 23
  6. 2025DA2: Depth Anything in Any Directioncited by 22
  7. 2024PanDA: Towards Panoramic Depth Anything with Unlabeled Panoramas and Mobius Spatial Augmentationcited by 21
  8. 2023PanelNet: Understanding 360 Indoor Environment via Panel Representationcited by 19
  9. 2024ZeroComp: Zero-shot Object Compositing from Image Intrinsics via Diffusioncited by 16
  10. 2024PatchRefiner: Leveraging Synthetic Data for Real-Domain High-Resolution Monocular Metric Depth Estimationcited by 15
  11. 2024Taming Stable Diffusion for Text to 360deg Panorama Image Generationcited by 12
  12. 2024SphereUFormer: A U-Shaped Transformer for Spherical 360 Perceptioncited by 12
  13. 2023RigNet++: Semantic Assisted Repetitive Image Guided Network for Depth Completioncited by 11
  14. 2025Scene4U: Hierarchical Layered 3D Scene Reconstruction from Single Panoramic Image for Your Immerse Explorationcited by 11
  15. 2024Semantics-Controlled Gaussian Splatting for Outdoor Scene Reconstruction and Rendering in Virtual Realitycited by 10
  16. 2024SGFormer: Spherical Geometry Transformer for 360 Depth Estimationcited by 9
  17. 2024FoVA-Depth: Field-of-View Agnostic Depth Estimation for Cross-Dataset Generalizationcited by 8
  18. 2025EDM: Equirectangular Projection-Oriented Dense Kernelized Feature Matchingcited by 7
  19. 2025PanoSplatt3R: Leveraging Perspective Pretraining for Generalized Unposed Wide-Baseline Panorama Reconstructioncited by 7
  20. 2026UniDAC: Universal Metric Depth Estimation for Any Cameracited by 7
  21. 2024Helvipad: A Real-World Dataset for Omnidirectional Stereo Depth Estimationcited by 6
  22. 2025Dur360BEV: A Real-world 360-degree Single Camera Dataset and Benchmark for Bird-Eye View Mapping in Autonomous Drivingcited by 5
  23. 2026VGGT-360: Geometry-Consistent Zero-Shot Panoramic Depth Estimationcited by 5
  24. 2023Robust Self-Supervised Extrinsic Self-Calibrationcited by 4
  25. 2024Amodal Depth Anything: Amodal Depth Estimation in the Wildcited by 4
  26. 2025RPG360: Robust 360 Depth Estimation with Perspective Foundation Models and Graph Optimizationcited by 4
  27. 2024Elite360M: Efficient 360 Multi-task Learning via Bi-projection Fusion and Cross-task Collaborationcited by 3
  28. 2024Multi-task Geometric Estimation of Depth and Surface Normal from Monocular 360deg Imagescited by 3
  29. 2026Wid3R: Wide Field-of-View 3D Reconstruction via Camera Model Conditioningcited by 3
  30. 2023ADU-Depth: Attention-based Distillation with Uncertainty Modeling for Depth Estimationcited by 2
  31. 2024MaGRITTe: Manipulative and Generative 3D Realization from Image, Topview and Textcited by 2
  32. 2025SphereFusion: Efficient Panorama Depth Estimation via Gated Fusioncited by 2
  33. 2025OB3D: A New Dataset for Benchmarking Omnidirectional 3D Reconstruction Using Blendercited by 2
  34. 2025DreamAnywhere: Object-Centric Panoramic 3D Scene Generationcited by 2
  35. 2026SphericalDreamer: Generating Navigable Immersive 3D Worlds with Panorama Fusioncited by 2
  36. 2022Cross-Domain Synthetic-to-Real In-the-Wild Depth and Normal Estimation for 3D Scene Understandingcited by 1
  37. 2023Panoramic Image-to-Image Translationcited by 1
  38. 2023Calibrating Panoramic Depth Estimation for Practical Localization and Mappingcited by 1

50 most cited of 60 All 60 (JSON)