Geo-Supervised Visual Depth Prediction
Not on the map. Why?
Abstract (arXiv)
We propose using global orientation from inertial measurements, and the bias it induces on the shape of objects populating the scene, to inform visual 3D reconstruction. We test the effect of using the resulting prior in depth prediction from a single image, where the normal vectors to surfaces of objects of certain classes tend to align with gravity or be orthogonal to it. Adding such a prior to baseline methods for monocular depth prediction yields improvements beyond the state-of-the-art and illustrates the power of gravity as a supervisory signal.
Key facts. Cited by 33 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 9; 2023: 6; 2024: 5; 2025: 4; 2026: 3.
33 papers.
Sort:
By area:
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 92
- 2022SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimationcited by 76
- 2021Unsupervised Depth Completion with Calibrated Backprojection Layerscited by 61
- 2021Learning Topology from Synthetic Data for Unsupervised Depth Completioncited by 38
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
- 2022Not Just Streaks: Towards Ground Truth for Single Image Derainingcited by 31
- 2021An Adaptive Framework for Learning Unsupervised Depth Completioncited by 30
- 2024Test-Time Adaptation for Depth Completioncited by 26
- 2022Monitored Distillation for Positive Congruent Depth Completioncited by 24
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 21
- 2021Learning Depth via Leveraging Semantics: Self-supervised Monocular Depth Estimation with Both Implicit and Explicit Semantic Guidancecited by 19
- 2023Monocular Visual-Inertial Depth Estimationcited by 18
21 more
- 2023Revisiting Depth Completion from a Stereo Matching Perspective for Cross-domain Generalizationcited by 18
- 2021Stereoscopic Universal Perturbations across Different Architectures and Datasetscited by 17
- 2023Enhancing Diffusion Models with 3D Perspective Geometry Constraintscited by 16
- 2023AugUndo: Scaling Up Augmentations for Monocular Depth Completion and Estimationcited by 15
- 2021Self-supervised 3D Representation Learning of Dressed Humans from Social Media Videoscited by 12
- 2025ProtoDepth: Unsupervised Continual Depth Completion with Prototypescited by 11
- 2022Struct-MDC: Mesh-Refined Unsupervised Depth Completion Leveraging Structural Regularities from Visual SLAMcited by 10
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokenscited by 9
- 2024All-day Depth Completioncited by 8
- 2022Physics vs. Learned Priors: Rethinking Camera and Algorithm Design for Task-Specific Imagingcited by 6
- 2025ETA: Energy-based Test-time Adaptation for Depth Completioncited by 4
- 2022U-HRNet: Delving into Improving Semantic Representation of High Resolution Network for Dense Predictioncited by 3
- 2022PIFu for the Real World: A Self-supervised Framework to Reconstruct Dressed Human from Single-view Imagescited by 2
- 2024Deep Cost Ray Fusion for Sparse Depth Video Completioncited by 1
- 2026Triangular Consistency as a Universal Constraint for Learning Optical Flowcited by 1
- 2026VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Cloudscited by 1
- 2022On the Viability of Monocular Depth Pre-training for Semantic Segmentationcited by 0
- 2023DEUX: Active Exploration for Learning Unsupervised Depth Perceptioncited by 0
- 2023Self-Supervised Depth Completion Guided by 3D Perception and Geometry Consistencycited by 0
- 2025VIMD: Monocular Visual-Inertial Motion and Depth Estimationcited by 0
- 2026From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentationcited by 0
- 2026From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentation28 Aug 2026
- 2026VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Clouds21 Aug 2026
- 2026Triangular Consistency as a Universal Constraint for Learning Optical Flow18 Jun 2026
- 2025VIMD: Monocular Visual-Inertial Motion and Depth Estimation24 Sep 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens6 Aug 2025
- 2025ProtoDepth: Unsupervised Continual Depth Completion with Prototypes17 Mar 2025
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptions3 Oct 2024
- 2024Deep Cost Ray Fusion for Sparse Depth Video Completion23 Sep 2024
- 2024All-day Depth Completion27 May 2024
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimation4 Apr 2024
- 2024Test-Time Adaptation for Depth Completion5 Feb 2024
21 more
- 2023Self-Supervised Depth Completion Guided by 3D Perception and Geometry Consistency23 Dec 2023
- 2023Revisiting Depth Completion from a Stereo Matching Perspective for Cross-domain Generalization14 Dec 2023
- 2023Enhancing Diffusion Models with 3D Perspective Geometry Constraints1 Dec 2023
- 2023AugUndo: Scaling Up Augmentations for Monocular Depth Completion and Estimation15 Oct 2023
- 2023DEUX: Active Exploration for Learning Unsupervised Depth Perception16 Sep 2023
- 2023Monocular Visual-Inertial Depth Estimation21 Mar 2023
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applications15 Nov 2022
- 2022U-HRNet: Delving into Improving Semantic Representation of High Resolution Network for Dense Prediction13 Oct 2022
- 2022PIFu for the Real World: A Self-supervised Framework to Reconstruct Dressed Human from Single-view Images23 Aug 2022
- 2022Not Just Streaks: Towards Ground Truth for Single Image Deraining22 Jun 2022
- 2022Struct-MDC: Mesh-Refined Unsupervised Depth Completion Leveraging Structural Regularities from Visual SLAM29 Apr 2022
- 2022Physics vs. Learned Priors: Rethinking Camera and Algorithm Design for Task-Specific Imaging21 Apr 2022
- 2022SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimation7 Apr 2022
- 2022Monitored Distillation for Positive Congruent Depth Completion30 Mar 2022
- 2022On the Viability of Monocular Depth Pre-training for Semantic Segmentation26 Mar 2022
- 2021Stereoscopic Universal Perturbations across Different Architectures and Datasets12 Dec 2021
- 2021Unsupervised Depth Completion with Calibrated Backprojection Layers24 Aug 2021
- 2021An Adaptive Framework for Learning Unsupervised Depth Completion6 Jun 2021
- 2021Learning Topology from Synthetic Data for Unsupervised Depth Completion6 Jun 2021
- 2021Self-supervised 3D Representation Learning of Dressed Humans from Social Media Videos4 Mar 2021
- 2021Learning Depth via Leveraging Semantics: Self-supervised Monocular Depth Estimation with Both Implicit and Explicit Semantic Guidance11 Feb 2021
- 2022Physics-Informed Machine Learning: A Survey on Problems, Methods and Applicationscited by 92
- 2022SurroundDepth: Entangling Surrounding Views for Self-Supervised Multi-Camera Depth Estimationcited by 76
- 2021Unsupervised Depth Completion with Calibrated Backprojection Layerscited by 61
- 2021Learning Topology from Synthetic Data for Unsupervised Depth Completioncited by 38
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimationcited by 34
- 2022Not Just Streaks: Towards Ground Truth for Single Image Derainingcited by 31
- 2021An Adaptive Framework for Learning Unsupervised Depth Completioncited by 30
- 2024Test-Time Adaptation for Depth Completioncited by 26
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptionscited by 21
- 2021Learning Depth via Leveraging Semantics: Self-supervised Monocular Depth Estimation with Both Implicit and Explicit Semantic Guidancecited by 19
- 2023Monocular Visual-Inertial Depth Estimationcited by 18
- 2023Revisiting Depth Completion from a Stereo Matching Perspective for Cross-domain Generalizationcited by 18
12 most cited of 31 All 31 (JSON)
- 2026From Perspective to Fisheye Depth Estimation and Open-Vocabulary Segmentation28 Aug 2026
- 2026VisTa3D: A Dataset and Benchmark for Thin Object Reconstruction from Vision, Tactile, and 3D Point Clouds21 Aug 2026
- 2026Triangular Consistency as a Universal Constraint for Learning Optical Flow18 Jun 2026
- 2025VIMD: Monocular Visual-Inertial Motion and Depth Estimation24 Sep 2025
- 2025ETA: Energy-based Test-time Adaptation for Depth Completion8 Aug 2025
- 2025Extending Foundational Monocular Depth Estimators to Fisheye Cameras with Calibration Tokens6 Aug 2025
- 2025ProtoDepth: Unsupervised Continual Depth Completion with Prototypes17 Mar 2025
- 2024RSA: Resolving Scale Ambiguities in Monocular Depth Estimators through Language Descriptions3 Oct 2024
- 2024Deep Cost Ray Fusion for Sparse Depth Video Completion23 Sep 2024
- 2024All-day Depth Completion27 May 2024
- 2024WorDepth: Variational Language Prior for Monocular Depth Estimation4 Apr 2024
- 2024Test-Time Adaptation for Depth Completion5 Feb 2024
12 newest of 31 All 31 (JSON)