mlsanityData to 7 Oct 2026

JEPADepth: Masked Predictive Representation Learning for Self-Supervised Monocular Depth Estimation

arXiv 2607.26600 ↗First posted 29 Jul 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Self-supervised monocular depth estimation typically relies on photometric reconstruction losses that couple depth, pose, and appearance assumptions. In this paper, we propose JEPADepth, a self-supervised monocular depth framework that incorporates a complementary training objective inspired by Image Joint-Embedding Predictive Architectures (I-JEPA) for self-supervised depth learning. Our method augments a standard photometric pipeline with a masked prediction loss computed in the representation space of a pretrained DINOv3 Vision Transformer encoder. A predictor infers target-region embeddings from visible context-region embeddings under structured masking, and is discarded along with the target encoder at inference time, adding no deployment cost. On KITTI, adding the JEPA objective consistently improves performance over the same DINOv3-based photometric baseline, without changing the inference-time architecture. Compared to prior monocular self-supervised methods, JEPADepth is competitive with state-of-the-art transformer-based approaches and outperforms strong CNN-based baselines on the standard benchmark. In zero-shot transfer (trained on KITTI and evaluated without fine-tuning), JEPADepth achieves the best or near-best performance among the compared methods on both Make3D and Cityscapes across multiple metrics.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 40 of its 47 references that are in the map. First posted on arXiv 29 Jul 2026.

Builds on

40 of 47 references.

References · 40

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
  4. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  5. 2021Vision Transformers for Dense Predictioncited by 1,789
  6. 2015Spatial Transformer Networkscited by 1,423
  7. 2025DINOv3cited by 1,297
  8. 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
  9. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  10. 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
  11. 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
  12. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
28 more
  1. 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
  2. 2017Sparsity Invariant CNNscited by 325
  3. 2018Competitive Collaboration: Joint Unsupervised Learning of Depth, Camera Motion, Optical Flow and Motion Segmentationcited by 222
  4. 2019Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Camerascited by 170
  5. 2018Unsupervised Learning of Monocular Depth Estimation and Visual Odometry with Deep Feature Reconstructioncited by 159
  6. 2017Learning Depth from Monocular Videos using Direct Methodscited by 154
  7. 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
  8. 2022MonoViT: Self-Supervised Monocular Depth Estimation with a Vision Transformercited by 136
  9. 2019Self-Supervised Monocular Depth Hintscited by 127
  10. 2020Self-supervised Monocular Trained Depth Estimation using Self-attention and Discrete Disparity Volumecited by 116
  11. 2020HR-Depth: High Resolution Self-Supervised Monocular Depth Estimationcited by 115
  12. 2022Lite-Mono: A Lightweight CNN and Transformer Architecture for Self-Supervised Monocular Depth Estimationcited by 100
  13. 2020Monocular Depth Estimation Based On Deep Learning: An Overviewcited by 68
  14. 2021Self-Supervised Monocular Depth Estimation with Internal Feature Fusioncited by 67
  15. 2021Channel-Wise Attention-Based Network for Self-Supervised Monocular Depth Estimationcited by 63
  16. 2019Unsupervised Monocular Depth and Ego-motion Learning with Structure and Semanticscited by 49
  17. 2018Unsupervised Adversarial Depth Estimation using Cycled Generative Networkscited by 45
  18. 2025What Drives Success in Physical Planning with Joint-Embedding Predictive World Models?cited by 37
  19. 2023Self-supervised Monocular Depth Estimation: Let's Talk About The Weathercited by 33
  20. 2020Perception and Navigation in Autonomous Systems in the Era of Learning: A Surveycited by 30
  21. 2024Point-JEPA: A Joint Embedding Predictive Architecture for Self-Supervised Learning on Point Cloudcited by 29
  22. 2022When the Sun Goes Down: Repairing Photometric Losses for All-Day Depth Estimationcited by 24
  23. 2023Self-Supervised Monocular Depth Estimation by Direction-aware Cumulative Convolution Networkcited by 14
  24. 2021On the Sins of Image Synthesis Loss for Self-supervised Depth Estimationcited by 7
  25. 2025Hybrid-grained Feature Aggregation with Coarse-to-fine Language Guidance for Self-supervised Monocular Depth Estimationcited by 6
  26. 2022Image Masking for Robust Self-Supervised Monocular Depth Estimationcited by 5
  27. 2024MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimationcited by 4
  28. 2025Self-supervised Monocular Depth Estimation Robust to Reflective Surface Leveraged by Triplet Miningcited by 2

Built on by

Not cited yet.