The Edge of Depth: Explicit Constraints between Segmentation and Depth
Not on the map. Why?
Abstract (arXiv)
In this work we study the mutual benefits of two common computer vision tasks, self-supervised depth estimation and semantic segmentation from images. For example, to help unsupervised monocular depth estimation, constraints from semantic segmentation has been explored implicitly such as sharing and transforming features. In contrast, we propose to explicitly measure the border consistency between segmentation and depth and minimize it in a greedy manner by iteratively supervising the network towards a locally optimal solution. Partially this is motivated by our observation that semantic segmentation even trained with limited ground truth (200 images of KITTI) can offer more accurate border than that of any (monocular or stereo) image-based depth estimation. Through extensive experiments, our proposed approach advances the state of the art on unsupervised monocular depth estimation in the KITTI.
Key facts. Cited by 72 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 14; 2022: 27; 2023: 11; 2024: 8; 2025: 5; 2026: 7.
72 papers.
Sort:
By area:
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 106
- 2021Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Mergingcited by 104
- 2021Self-Supervised Monocular Depth Estimation with Internal Feature Fusioncited by 67
- 2021Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimationcited by 55
- 2021Radar-Camera Pixel Depth Association for Depth Completioncited by 49
- 2021Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimationcited by 48
- 2021Depth Completion with Twin Surface Extrapolation at Occlusion Boundariescited by 41
- 2022RA-Depth: Resolution Adaptive Self-Supervised Monocular Depth Estimationcited by 36
- 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimationcited by 35
- 2023Tame a Wild Camera: In-the-Wild Monocular Camera Calibrationcited by 34
- 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planescited by 32
38 more
- 2021PLADE-Net: Towards Pixel-Level Accuracy for Self-Supervised Single-View Depth Estimation with Neural Positional Encoding and Distilled Matting Losscited by 31
- 2021SVDistNet: Self-Supervised Near-Field Distance Estimation on Surround View Fisheye Camerascited by 25
- 2022DevNet: Self-supervised Monocular Depth Learning via Density Volume Constructioncited by 22
- 2023SQLdepth: Generalizable Self-Supervised Fine-Structured Monocular Depth Estimationcited by 21
- 2022Self-Supervised Monocular Depth Estimation: Solving the Edge-Fattening Problemcited by 20
- 2021Learning Depth via Leveraging Semantics: Self-supervised Monocular Depth Estimation with Both Implicit and Explicit Semantic Guidancecited by 19
- 2022Semantic-SuPer: A Semantic-aware Surgical Perception Framework for Endoscopic Tissue Identification, Reconstruction, and Trackingcited by 19
- 2023EVEN: An Event-Based Framework for Monocular Depth Estimation at Adverse Night Conditionscited by 19
- 2022Self-distilled Feature Aggregation for Self-supervised Monocular Depth Estimationcited by 17
- 2022Detecting Adversarial Perturbations in Multi-Task Perceptioncited by 15
- 2021Towards Interpretable Deep Networks for Monocular Depth Estimationcited by 12
- 2021X-Distill: Improving Self-Supervised Monocular Depth via Cross-Task Distillationcited by 12
- 2023Temporally Consistent Online Depth Estimation Using Point-Based Fusioncited by 12
- 2023Delving into Crispness: Guided Label Refinement for Crisp Edge Detectioncited by 10
- 2021THE Benchmark: Transferable Representation Learning for Monocular Height Estimationcited by 8
- 2022Mind The Edge: Refining Depth Edges in Sparsely-Supervised Monocular Depth Estimationcited by 8
- 2023Two-in-One Depth: Bridging the Gap Between Monocular and Binocular Self-supervised Depth Estimationcited by 8
- 2023Joint Depth Prediction and Semantic Segmentation with Multi-View SAMcited by 8
- 2024SPIdepth: Strengthened Pose Information for Self-supervised Monocular Depth Estimationcited by 8
- 2022Learning Occlusion-Aware Coarse-to-Fine Depth Map for Self-supervised Monocular Depth Estimationcited by 6
- 2025Hybrid-grained Feature Aggregation with Coarse-to-fine Language Guidance for Self-supervised Monocular Depth Estimationcited by 6
- 2022Layered Depth Refinement with Mask Guidancecited by 5
- 2022UAMD-Net: A Unified Adaptive Multimodal Neural Network for Dense Depth Completioncited by 4
- 2023Transformer-based Multimodal Change Detection with Multitask Consistency Constraintscited by 4
- 2024MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimationcited by 4
- 2024RePLAy: Remove Projective LiDAR Depthmap Artifacts via Exploiting Epipolar Geometrycited by 4
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Trainingcited by 4
- 2025Towards Reliable Identification of Diffusion-based Image Manipulationscited by 4
- 2025DGFusion: Depth-Guided Sensor Fusion for Robust Semantic Perceptioncited by 4
- 2022Disentangled Latent Transformer for Interpretable Monocular Height Estimationcited by 3
- 2022Frequency-Aware Self-Supervised Monocular Depth Estimationcited by 3
- 2024GAM-Depth: Self-Supervised Indoor Depth Estimation Leveraging a Gradient-Aware Mask and Semantic Constraintscited by 3
- 2025Distribution-Specific Learning for Joint Salient and Camouflaged Object Detectioncited by 3
- 2021Improving Online Performance Prediction for Semantic Segmentationcited by 2
- 2022How Much Depth Information can Radar Contribute to a Depth Estimation Model?cited by 2
- 2022Zero Pixel Directional Boundary by Vector Transformcited by 2
- 2022DepthGAN: GAN-based Depth Generation of Indoor Scenes from Semantic Layoutscited by 2
- 2022Positional Information is All You Need: A Novel Pipeline for Self-Supervised SVDE from Videoscited by 2
50 most cited of 72 All 72 (JSON)
- 2026DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy15 May 2026
- 2026Improved monocular depth prediction using distance transform over pre-semantic contours with self-supervised neural networks8 May 2026
- 2026SS3D: End2End Self-Supervised 3D from Web Videos24 Apr 2026
- 2026Towards Intrinsic-Aware Monocular 3D Object Detection28 Mar 2026
- 2026HAD: Heterogeneity-Aware Distillation for Lifelong Heterogeneous Learning27 Mar 2026
- 2026MatchED: Crisp Edge Detection Using End-to-End, Matching-based Supervision24 Feb 2026
- 2026SHED Light on Segmentation for Dense Prediction30 Jan 2026
- 2025Hybrid-grained Feature Aggregation with Coarse-to-fine Language Guidance for Self-supervised Monocular Depth Estimation10 Oct 2025
- 2025DGFusion: Depth-Guided Sensor Fusion for Robust Semantic Perception11 Sep 2025
- 2025Distribution-Specific Learning for Joint Salient and Camouflaged Object Detection8 Aug 2025
- 2025Towards Reliable Identification of Diffusion-based Image Manipulations5 Jun 2025
- 2025EDMB: Edge Detector with Mamba8 Jan 2025
38 more
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Training4 Nov 2024
- 2024A new baseline for edge detection: Make Encoder-Decoder great again23 Sep 2024
- 2024Revisit Self-supervised Depth Estimation with Local Structure-from-Motion27 Jul 2024
- 2024RePLAy: Remove Projective LiDAR Depthmap Artifacts via Exploiting Epipolar Geometry27 Jul 2024
- 2024MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimation6 Jun 2024
- 2024SPIdepth: Strengthened Pose Information for Self-supervised Monocular Depth Estimation18 Apr 2024
- 2024Scene Depth Estimation from Traditional Oriental Landscape Paintings6 Mar 2024
- 2024GAM-Depth: Self-Supervised Indoor Depth Estimation Leveraging a Gradient-Aware Mask and Semantic Constraints22 Feb 2024
- 2023Joint Depth Prediction and Semantic Segmentation with Multi-View SAM31 Oct 2023
- 2023Transformer-based Multimodal Change Detection with Multitask Consistency Constraints13 Oct 2023
- 2023Two-in-One Depth: Bridging the Gap Between Monocular and Binocular Self-supervised Depth Estimation2 Sep 2023
- 2023SQLdepth: Generalizable Self-Supervised Fine-Structured Monocular Depth Estimation1 Sep 2023
- 2023Compact Twice Fusion Network for Edge Detection11 Jul 2023
- 2023Delving into Crispness: Guided Label Refinement for Crisp Edge Detection27 Jun 2023
- 2023Tame a Wild Camera: In-the-Wild Monocular Camera Calibration19 Jun 2023
- 2023Temporally Consistent Online Depth Estimation Using Point-Based Fusion15 Apr 2023
- 2023SemHint-MD: Learning from Noisy Semantic Labels for Self-Supervised Monocular Depth Estimation31 Mar 2023
- 2023EVEN: An Event-Based Framework for Monocular Depth Estimation at Adverse Night Conditions8 Feb 2023
- 2023FG-Depth: Flow-Guided Unsupervised Monocular Depth Estimation20 Jan 2023
- 2022ROIFormer: Semantic-Aware Region of Interest Transformer for Efficient Self-Supervised Monocular Depth Estimation12 Dec 2022
- 2022Mind The Edge: Refining Depth Edges in Sparsely-Supervised Monocular Depth Estimation10 Dec 2022
- 2022Hybrid Transformer Based Feature Fusion for Self-Supervised Monocular Depth Estimation20 Nov 2022
- 2022Semantic-SuPer: A Semantic-aware Surgical Perception Framework for Endoscopic Tissue Identification, Reconstruction, and Tracking29 Oct 2022
- 2022Frequency-Aware Self-Supervised Monocular Depth Estimation11 Oct 2022
- 2022TriangleNet: Edge Prior Augmented Network for Semantic Segmentation through Cross-Task Consistency11 Oct 2022
- 2022Detaching and Boosting: Dual Engine for Scale-Invariant Self-Supervised Monocular Depth Estimation8 Oct 2022
- 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planes4 Oct 2022
- 2022Self-Supervised Monocular Depth Estimation: Solving the Edge-Fattening Problem2 Oct 2022
- 2022Self-distilled Feature Aggregation for Self-supervised Monocular Depth Estimation15 Sep 2022
- 2022DevNet: Self-supervised Monocular Depth Learning via Density Volume Construction14 Sep 2022
- 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimation7 Sep 2022
- 2022LiteDepth: Digging into Fast and Accurate Depth Estimation on Mobile Devices2 Sep 2022
- 2022RA-Depth: Resolution Adaptive Self-Supervised Monocular Depth Estimation25 Jul 2022
- 2022Monocular Depth Decomposition of Semi-Transparent Volume Renderings27 Jun 2022
- 2022Layered Depth Refinement with Mask Guidance7 Jun 2022
- 2022Positional Information is All You Need: A Novel Pipeline for Self-Supervised SVDE from Videos18 May 2022
- 2022UAMD-Net: A Unified Adaptive Multimodal Neural Network for Dense Depth Completion16 Apr 2022
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Prior5 Apr 2022
50 newest of 72 All 72 (JSON)
- 2022BinsFormer: Revisiting Adaptive Bins for Monocular Depth Estimationcited by 166
- 2022P3Depth: Monocular Depth Estimation with a Piecewise Planarity Priorcited by 106
- 2021Boosting Monocular Depth Estimation Models to High-Resolution via Content-Adaptive Multi-Resolution Mergingcited by 104
- 2021Self-Supervised Monocular Depth Estimation with Internal Feature Fusioncited by 67
- 2021Fine-grained Semantics-aware Representation Enhancement for Self-supervised Monocular Depth Estimationcited by 55
- 2021Radar-Camera Pixel Depth Association for Depth Completioncited by 49
- 2021Excavating the Potential Capacity of Self-Supervised Monocular Depth Estimationcited by 48
- 2021Depth Completion with Twin Surface Extrapolation at Occlusion Boundariescited by 41
- 2022RA-Depth: Resolution Adaptive Self-Supervised Monocular Depth Estimationcited by 36
- 2022BiFuse++: Self-supervised and Efficient Bi-projection Fusion for 360 Depth Estimationcited by 35
- 2023Tame a Wild Camera: In-the-Wild Monocular Camera Calibrationcited by 34
- 2022PlaneDepth: Self-supervised Depth Estimation via Orthogonal Planescited by 32
12 most cited of 69 All 69 (JSON)
- 2026DepthPolyp: Pseudo-Depth Guided Lightweight Segmentation for Real-Time Colonoscopy15 May 2026
- 2026Improved monocular depth prediction using distance transform over pre-semantic contours with self-supervised neural networks8 May 2026
- 2026SS3D: End2End Self-Supervised 3D from Web Videos24 Apr 2026
- 2026Towards Intrinsic-Aware Monocular 3D Object Detection28 Mar 2026
- 2026HAD: Heterogeneity-Aware Distillation for Lifelong Heterogeneous Learning27 Mar 2026
- 2026MatchED: Crisp Edge Detection Using End-to-End, Matching-based Supervision24 Feb 2026
- 2026SHED Light on Segmentation for Dense Prediction30 Jan 2026
- 2025Hybrid-grained Feature Aggregation with Coarse-to-fine Language Guidance for Self-supervised Monocular Depth Estimation10 Oct 2025
- 2025DGFusion: Depth-Guided Sensor Fusion for Robust Semantic Perception11 Sep 2025
- 2025Distribution-Specific Learning for Joint Salient and Camouflaged Object Detection8 Aug 2025
- 2024Improving Domain Generalization in Self-supervised Monocular Depth Estimation via Stabilized Adversarial Training4 Nov 2024
- 2024A new baseline for edge detection: Make Encoder-Decoder great again23 Sep 2024
12 newest of 69 All 69 (JSON)