mlsanityData to 7 Oct 2026

Scale-invariant and View-relational Representation Learning for Full Surround Monocular Depth

arXiv 2512.08700 ↗First posted 9 Dec 2025cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent foundation models demonstrate strong generalization capabilities in monocular depth estimation. However, directly applying these models to Full Surround Monocular Depth Estimation (FSMDE) presents two major challenges: (1) high computational cost, which limits real-time performance, and (2) difficulty in estimating metric-scale depth, as these models are typically trained to predict only relative depth. To address these limitations, we propose a novel knowledge distillation strategy that transfers robust depth knowledge from a foundation model to a lightweight FSMDE network. Our approach leverages a hybrid regression framework combining the knowledge distillation scheme--traditionally used in classification--with a depth binning module to enhance scale consistency. Specifically, we introduce a cross-interaction knowledge distillation scheme that distills the scale-invariant depth bin probabilities of a foundation model into the student network while guiding it to infer metric-scale depth bin centers from ground-truth depth. Furthermore, we propose view-relational knowledge distillation, which encodes structural relationships among adjacent camera views and transfers them to enhance cross-view depth consistency. Experiments on DDAD and nuScenes demonstrate the effectiveness of our method compared to conventional supervised methods and existing knowledge distillation approaches. Moreover, our method achieves a favorable trade-off between performance and efficiency, meeting real-time requirements.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 51 references that are in the map. First posted on arXiv 9 Dec 2025.

Builds on

40 of 51 references.

References · 40

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2023Segment Anythingcited by 8,158
  4. 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,485
  5. 2016Learning without Forgettingcited by 2,465
  6. 2021Vision Transformers for Dense Predictioncited by 1,789
  7. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  8. 2024Depth Anything V2cited by 1,385
  9. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  10. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  11. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
  12. 2019Relational Knowledge Distillationcited by 873
28 more
  1. 2019Contrastive Representation Distillationcited by 734
  2. 2018Deep Ordinal Regression Network for Monocular Depth Estimationcited by 721
  3. 2023ZoeDepth: Zero-shot Transfer by Combining Relative and Metric Depthcited by 646
  4. 2020AdaBins: Depth Estimation using Adaptive Binscited by 596
  5. 2019Similarity-Preserving Knowledge Distillationcited by 507
  6. 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
  7. 2024Depth Pro: Sharp Monocular Metric Depth in Less Than a Secondcited by 395
  8. 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
  9. 2024UniDepth: Universal Monocular Metric Depth Estimationcited by 375
  10. 2023Repurposing Diffusion-Based Image Generators for Monocular Depth Estimationcited by 323
  11. 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
  12. 2022Knowledge Distillation with the Reused Teacher Classifiercited by 140
  13. 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
  14. 2020HR-Depth: High Resolution Self-Supervised Monocular Depth Estimationcited by 115
  15. 2022LocalBins: Improving Depth Estimation by Learning Local Distributionscited by 92
  16. 2018Structured Attention Guided Convolutional Neural Fields for Monocular Depth Estimationcited by 78
  17. 2022SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimationcited by 76
  18. 2022Global-Local Path Networks for Monocular Depth Estimation with Vertical CutDepthcited by 58
  19. 2019Refine and Distill: Exploiting Cycle-Inconsistency and Knowledge Distillation for Unsupervised Monocular Depth Estimationcited by 48
  20. 2023NDDepth: Normal-Distance Assisted Monocular Depth Estimationcited by 45
  21. 2021Full Surround Monodepth from Multiple Camerascited by 41
  22. 2022Cross-Architecture Knowledge Distillationcited by 40
  23. 2023R3D3: Dense 3D Reconstruction of Dynamic Scenes from Multiple Camerascited by 39
  24. 2023EGA-Depth: Efficient Guided Attention for Self-Supervised Multi-Camera Depth Estimationcited by 16
  25. 2024Depth-discriminative Metric Learning for Monocular 3D Object Detectioncited by 8
  26. 2024Towards Cross-View-Consistent Self-Supervised Surround Depth Estimationcited by 7
  27. 2023A Study on the Generality of Neural Network Structures for Monocular Depth Estimationcited by 4
  28. 2025Self-supervised Monocular Depth Estimation Robust to Reflective Surface Leveraged by Triplet Miningcited by 2

Built on by

Not cited yet.