mlsanityData to 14 Oct 2026

CamLessMonoDepth: Monocular Depth Estimation with Unknown Camera Parameters

arXiv 2110.14347 ↗First posted 27 Oct 2021cs.CVcited by 8

Not on the map. Why?

Abstract (arXiv)

Perceiving 3D information is of paramount importance in many applications of computer vision. Recent advances in monocular depth estimation have shown that gaining such knowledge from a single camera input is possible by training deep neural networks to predict inverse depth and pose, without the necessity of ground truth data. The majority of such approaches, however, require camera parameters to be fed explicitly during training. As a result, image sequences from wild cannot be used during training. While there exist methods which also predict camera intrinsics, their performance is not on par with novel methods taking camera parameters as input. In this work, we propose a method for implicit estimation of pinhole camera intrinsics along with depth and pose, by learning from monocular image sequences alone. In addition, by utilizing efficient sub-pixel convolutions, we show that high fidelity depth estimates can be obtained. We also embed pixel-wise uncertainty estimation into the framework, to emphasize the possible applicability of this work in practical domain. Finally, we demonstrate the possibility of accurate prediction of depth information without prior knowledge of camera intrinsics, while outperforming the existing state-of-the-art approaches on KITTI benchmark.

Key facts. Cited by 8 papers in the map (data through 14 Oct 2026). Builds on 51 of its 67 references that are in the map. First posted on arXiv 27 Oct 2021.

Builds on

51 of 67 references.

References · 51

  1. 2014Adam: A Method for Stochastic Optimizationcited by 37,240
  2. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  4. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,498
  5. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
  6. 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,546
  7. 2017What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision?cited by 2,352
  8. 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
  9. 2019Towards Robust Monocular Depth Estimation: Mixing Datasets for Zero-shot Cross-dataset Transfercited by 1,495
  10. 2015Spatial Transformer Networkscited by 1,429
  11. 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
  12. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,274
38 more
  1. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 820
  2. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 782
  3. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 723
  4. 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
  5. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 439
  6. 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
  7. 2018GeoNet: Unsupervised Learning of Dense Depth, Optical Flow and Camera Posecited by 342
  8. 2017Sparsity Invariant CNNscited by 326
  9. 2015Deeply-Recursive Convolutional Network for Image Super-Resolutioncited by 317
  10. 2019Billion-scale semi-supervised learning for image classificationcited by 232
  11. 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
  12. 2020D3VO: Deep Depth, Deep Pose and Deep Uncertainty for Monocular Visual Odometrycited by 206
  13. 2020A2D2: Audi Autonomous Driving Datasetcited by 190
  14. 2020On the uncertainty of self-supervised monocular depth estimationcited by 182
  15. 2018Unsupervised Learning of Depth and Ego-Motion from Monocular Video Using 3D Geometric Constraintscited by 179
  16. 2019Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Camerascited by 170
  17. 2018Depth Prediction Without the Sensors: Leveraging Structure for Unsupervised Learning from Monocular Videoscited by 155
  18. 2017Learning Depth from Monocular Videos using Direct Methodscited by 154
  19. 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
  20. 2018High Quality Monocular Depth Estimation via Transfer Learningcited by 133
  21. 2019Self-supervised Learning with Geometric Constraints in Monocular Video: Connecting Flow, Depth, and Cameracited by 130
  22. 2020Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volumecited by 116
  23. 2020HR-Depth: High Resolution Self-Supervised Monocular Depth Estimationcited by 115
  24. 2017Semi-Supervised Deep Learning for Monocular Depth Map Predictioncited by 109
  25. 2018Every Pixel Counts ++: Joint Learning of Geometry and Motion with 3D Holistic Understandingcited by 101
  26. 2017SfM-Net: Learning of Structure and Motion from Videocited by 89
  27. 2019CAM-Convs: Camera-Aware Multi-Scale Convolutions for Single-View Depthcited by 75
  28. 2020Monocular Depth Estimation Based On Deep Learning: An Overviewcited by 68
  29. 2018Learning Monocular Depth by Distilling Cross-domain Stereo Networkscited by 64
  30. 2018SuperDepth: Self-Supervised, Super-Resolved Monocular Depth Estimationcited by 64
  31. 2014Designing Deep Networks for Surface Normal Estimationcited by 59
  32. 2018What Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation?cited by 44
  33. 2020Toward Hierarchical Self-Supervised Monocular Absolute Depth Estimation for Autonomous Driving Applicationscited by 40
  34. 2018Single View Stereo Matchingcited by 39
  35. 2020Distilled Semantics for Comprehensive Scene Understanding from Videoscited by 39
  36. 2017Checkerboard artifact free sub-pixel convolution: A note on sub-pixel convolution, resize convolution and convolution resizecited by 37
  37. 2020DESC: Domain Adaptation for Depth Estimation via Semantic Consistencycited by 25
  38. 2019Enhancing self-supervised monocular depth estimation with traditional visual odometrycited by 9

50 most cited of 51 All 51 (JSON)

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 2; 2023: 4; 2024: 1.

8 papers.