Geometric Unsupervised Domain Adaptation for Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
Simulators can efficiently generate large amounts of labeled synthetic data with perfect supervision for hard-to-label tasks like semantic segmentation. However, they introduce a domain gap that severely hurts real-world performance. We propose to use self-supervised monocular depth estimation as a proxy task to bridge this gap and improve sim-to-real unsupervised domain adaptation (UDA). Our Geometric Unsupervised Domain Adaptation method (GUDA) learns a domain-invariant representation via a multi-task objective combining synthetic semantic supervision with real-world geometric constraints on videos. GUDA establishes a new state of the art in UDA for semantic segmentation on three benchmarks, outperforming methods that use domain adversarial learning, self-training, or other self-supervised proxy tasks. Furthermore, we show that our method scales well with the quality and quantity of synthetic data while also improving depth prediction.
Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). Builds on 65 of its 82 references that are in the map. First posted on arXiv 30 Mar 2021.
Builds on
65 of 82 references.
References · 65
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2018Unsupervised Representation Learning by Predicting Image Rotationscited by 1,586
- 2016Unsupervised Learning of Visual Representations by Solving Jigsaw Puzzlescited by 1,379
- 2014Depth Map Prediction from a Single Image using a Multi-Scale Deep Networkcited by 1,264
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
- 2015Fast and Accurate Deep Network Learning by Exponential Linear Units (ELUs)cited by 1,061
- 2016Unsupervised Monocular Depth Estimation with Left-Right Consistencycited by 819
- 2016Playing for Data: Ground Truth from Computer Gamescited by 816
- 2017Unsupervised Learning of Depth and Ego-Motion from Videocited by 778
38 more
- 2017Maximum Classifier Discrepancy for Unsupervised Domain Adaptationcited by 682
- 2018Deep Visual Domain Adaptation: A Surveycited by 634
- 2018ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentationcited by 623
- 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 597
- 2020FDA: Fourier Domain Adaptation for Semantic Segmentationcited by 540
- 2014Predicting Depth, Surface Normals and Semantic Labels with a Common Multi-Scale Convolutional Architecturecited by 483
- 2016Cross-stitch Networks for Multi-task Learningcited by 466
- 2019Domain Generalization by Solving Jigsaw Puzzlescited by 449
- 20193D Packing for Self-Supervised Monocular Depth Estimationcited by 437
- 2019Confidence Regularized Self-Trainingcited by 418
- 2019From Big to Small: Multi-Scale Local Planar Guidance for Monocular Depth Estimationcited by 379
- 2016Unsupervised CNN for Single View Depth Estimation: Geometry to the Rescuecited by 368
- 2018A Survey of Unsupervised Deep Domain Adaptationcited by 361
- 2020Virtual KITTI 2cited by 345
- 2016Virtual Worlds as Proxy for Multi-Object Tracking Analysiscited by 340
- 2016Unsupervised Pixel-Level Domain Adaptation with Generative Adversarial Networkscited by 307
- 2018Taking A Closer Look at Domain Shift: Category-level Adversaries for Semantics Consistent Domain Adaptationcited by 295
- 2016Learning Representations for Automatic Colorizationcited by 251
- 2016FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptationcited by 242
- 2015DeepStereo: Learning to Predict New Views from the World's Imagerycited by 185
- 2020Instance Adaptive Self-Training for Unsupervised Domain Adaptationcited by 177
- 2019Depth from Videos in the Wild: Unsupervised Monocular Depth Learning from Unknown Camerascited by 170
- 2015Attention to Scale: Scale-aware Semantic Image Segmentationcited by 169
- 2016Deep Reconstruction-Classification Networks for Unsupervised Domain Adaptationcited by 162
- 2019Domain Adaptation for Structured Output via Discriminative Patch Representationscited by 150
- 2020Feature-metric Loss for Self-supervised Learning of Depth and Egomotioncited by 140
- 2020Semantically-Guided Representation Learning for Self-Supervised Monocular Depthcited by 134
- 2017Domain Adaptation for Visual Applications: A Comprehensive Surveycited by 127
- 2017Augmented Reality Meets Computer Vision : Efficient Data Generation for Urban Driving Scenescited by 122
- 2018Learning Semantic Segmentation from Synthetic Data: A Geometrically Guided Input-Output Adaptation Approachcited by 119
- 2019Unsupervised Domain Adaptation through Self-Supervisioncited by 116
- 2017Adversarial Dropout Regularizationcited by 106
- 2018DCAN: Dual Channel-wise Alignment Networks for Unsupervised Scene Adaptationcited by 101
- 2019DADA: Depth-aware Domain Adaptation in Semantic Segmentationcited by 97
- 2016Learning Dense Correspondence via 3D-guided Cycle Consistencycited by 91
- 2018Fully Convolutional Adaptation Networks for Semantic Segmentationcited by 75
- 2019Discriminative Adversarial Domain Adaptationcited by 74
- 2018Self-Supervised Model Adaptation for Multimodal Semantic Segmentationcited by 73
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2021: 2; 2022: 10; 2023: 11; 2024: 6; 2025: 3; 2026: 1.
33 papers.
Sort:
By area:
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 100
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectivescited by 98
- 2022Multi-Frame Self-Supervised Depth with Transformerscited by 64
- 2021Multi-Modal 3D Object Detection in Autonomous Driving: a Surveycited by 63
- 2022Learning Optical Flow, Depth, and Scene Flow without Real-World Labelscited by 31
- 2024Cross-View Completion Models are Zero-shot Correspondence Estimatorscited by 30
- 2023Survey on Unsupervised Domain Adaptation for Semantic Segmentation for Visual Perception in Automated Drivingcited by 29
- 2023Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Modelcited by 29
- 2023Semantic Image Segmentation: Two Decades of Researchcited by 26
- 2021Improving Semi-Supervised and Domain-Adaptive Semantic Segmentation with Self-Supervised Depth Estimationcited by 25
- 2022DenseMTL: Cross-task Attention Mechanism for Dense Multi-task Learningcited by 25
- 2022SELMA: SEmantic Large-scale Multimodal Acquisitions in Variable Weather, Daytime and Viewpointscited by 22
21 more
- 2022DecoupleNet: Decoupled Network for Domain Adaptive Semantic Segmentationcited by 22
- 2023CoDEPS: Online Continual Learning for Depth Estimation and Panoptic Segmentationcited by 18
- 2023DualRefine: Self-Supervised Depth and Pose Estimation Through Iterative Epipolar Sampling and Refinement Toward Equilibriumcited by 16
- 2023Tracking through Containers and Occluders in the Wildcited by 15
- 2024MICDrop: Masking Image and Depth Features via Complementary Dropout for Domain-Adaptive Semantic Segmentationcited by 13
- 2022Crafting Monocular Cues and Velocity Guidance for Self-Supervised Multi-Frame Depth Learningcited by 12
- 2025Zero-Shot Novel View and Depth Synthesis with Multi-View Geometric Diffusioncited by 12
- 2026AnyView: Synthesizing Any Novel View in Dynamic Scenescited by 12
- 2024GRIN: Zero-Shot Metric Depth with Pixel-Level Diffusioncited by 6
- 2025Towards In-the-wild 3D Plane Reconstruction from a Single Imagecited by 6
- 2022Photo-realistic Neural Domain Randomizationcited by 5
- 2025Unlocking Constraints: Source-Free Occlusion-Aware Seamless Segmentationcited by 3
- 2022Multi-view Monocular Depth and Uncertainty Prediction with Deep SfM in Dynamic Environmentscited by 2
- 2023MoDA: Leveraging Motion Priors from Videos for Advancing Unsupervised Domain Adaptation in Semantic Segmentationcited by 2
- 2023Towards Dynamic and Small Objects Refinement for Unsupervised Domain Adaptative Nighttime Semantic Segmentationcited by 2
- 2023Do More With What You Have: Transferring Depth-Scale from Labeled to Unlabeled Domainscited by 1
- 2023HQDec: Self-Supervised Monocular Depth Estimation Based on a High-Quality Decodercited by 1
- 2024MCDS-VSS: Moving Camera Dynamic Scene Video Semantic Segmentation by Filtering with Self-Supervised Geometry and Motioncited by 1
- 2022ELDA: Using Edges to Have an Edge on Semantic Segmentation Based UDAcited by 0
- 2024Enhancing AI Diagnostics: Autonomous Lesion Masking via Semi-Supervised Deep Learningcited by 0
- 2024FA-Depth: Toward Fast and Accurate Self-supervised Monocular Depth Estimationcited by 0
- 2026AnyView: Synthesizing Any Novel View in Dynamic Scenes23 Jan 2026
- 2025Unlocking Constraints: Source-Free Occlusion-Aware Seamless Segmentation26 Jun 2025
- 2025Towards In-the-wild 3D Plane Reconstruction from a Single Image3 Jun 2025
- 2025Zero-Shot Novel View and Depth Synthesis with Multi-View Geometric Diffusion30 Jan 2025
- 2024Cross-View Completion Models are Zero-shot Correspondence Estimators12 Dec 2024
- 2024GRIN: Zero-Shot Metric Depth with Pixel-Level Diffusion15 Sep 2024
- 2024MICDrop: Masking Image and Depth Features via Complementary Dropout for Domain-Adaptive Semantic Segmentation29 Aug 2024
- 2024MCDS-VSS: Moving Camera Dynamic Scene Video Semantic Segmentation by Filtering with Self-Supervised Geometry and Motion30 May 2024
- 2024FA-Depth: Toward Fast and Accurate Self-supervised Monocular Depth Estimation17 May 2024
- 2024Enhancing AI Diagnostics: Autonomous Lesion Masking via Semi-Supervised Deep Learning18 Apr 2024
- 2023Zero-Shot Metric Depth with a Field-of-View Conditioned Diffusion Model20 Dec 2023
- 2023Towards Dynamic and Small Objects Refinement for Unsupervised Domain Adaptative Nighttime Semantic Segmentation7 Oct 2023
21 more
- 2023MoDA: Leveraging Motion Priors from Videos for Advancing Unsupervised Domain Adaptation in Semantic Segmentation21 Sep 2023
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimation29 Jun 2023
- 2023HQDec: Self-Supervised Monocular Depth Estimation Based on a High-Quality Decoder30 May 2023
- 2023Tracking through Containers and Occluders in the Wild4 May 2023
- 2023Survey on Unsupervised Domain Adaptation for Semantic Segmentation for Visual Perception in Automated Driving24 Apr 2023
- 2023DualRefine: Self-Supervised Depth and Pose Estimation Through Iterative Epipolar Sampling and Refinement Toward Equilibrium7 Apr 2023
- 2023CoDEPS: Online Continual Learning for Depth Estimation and Panoptic Segmentation17 Mar 2023
- 2023Do More With What You Have: Transferring Depth-Scale from Labeled to Unlabeled Domains14 Mar 2023
- 2023Semantic Image Segmentation: Two Decades of Research13 Feb 2023
- 2022ELDA: Using Edges to Have an Edge on Semantic Segmentation Based UDA16 Nov 2022
- 2022Photo-realistic Neural Domain Randomization23 Oct 2022
- 2022Crafting Monocular Cues and Velocity Guidance for Self-Supervised Multi-Frame Depth Learning19 Aug 2022
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectives15 Aug 2022
- 2022DecoupleNet: Decoupled Network for Domain Adaptive Semantic Segmentation20 Jul 2022
- 2022DenseMTL: Cross-task Attention Mechanism for Dense Multi-task Learning17 Jun 2022
- 2022SELMA: SEmantic Large-scale Multimodal Acquisitions in Variable Weather, Daytime and Viewpoints20 Apr 2022
- 2022Multi-Frame Self-Supervised Depth with Transformers15 Apr 2022
- 2022Learning Optical Flow, Depth, and Scene Flow without Real-World Labels28 Mar 2022
- 2022Multi-view Monocular Depth and Uncertainty Prediction with Deep SfM in Dynamic Environments21 Jan 2022
- 2021Improving Semi-Supervised and Domain-Adaptive Semantic Segmentation with Self-Supervised Depth Estimation28 Aug 2021
- 2021Multi-Modal 3D Object Detection in Autonomous Driving: a Survey24 Jun 2021
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 100
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectivescited by 98
- 2022Multi-Frame Self-Supervised Depth with Transformerscited by 64
- 2021Multi-Modal 3D Object Detection in Autonomous Driving: a Surveycited by 63
- 2022Learning Optical Flow, Depth, and Scene Flow without Real-World Labelscited by 31
- 2024Cross-View Completion Models are Zero-shot Correspondence Estimatorscited by 30
- 2023Survey on Unsupervised Domain Adaptation for Semantic Segmentation for Visual Perception in Automated Drivingcited by 29
- 2023Semantic Image Segmentation: Two Decades of Researchcited by 26
- 2021Improving Semi-Supervised and Domain-Adaptive Semantic Segmentation with Self-Supervised Depth Estimationcited by 25
- 2022DenseMTL: Cross-task Attention Mechanism for Dense Multi-task Learningcited by 25
- 2022SELMA: SEmantic Large-scale Multimodal Acquisitions in Variable Weather, Daytime and Viewpointscited by 22
- 2022DecoupleNet: Decoupled Network for Domain Adaptive Semantic Segmentationcited by 22
12 most cited of 31 All 31 (JSON)
- 2026AnyView: Synthesizing Any Novel View in Dynamic Scenes23 Jan 2026
- 2025Unlocking Constraints: Source-Free Occlusion-Aware Seamless Segmentation26 Jun 2025
- 2025Towards In-the-wild 3D Plane Reconstruction from a Single Image3 Jun 2025
- 2025Zero-Shot Novel View and Depth Synthesis with Multi-View Geometric Diffusion30 Jan 2025
- 2024Cross-View Completion Models are Zero-shot Correspondence Estimators12 Dec 2024
- 2024MICDrop: Masking Image and Depth Features via Complementary Dropout for Domain-Adaptive Semantic Segmentation29 Aug 2024
- 2024MCDS-VSS: Moving Camera Dynamic Scene Video Semantic Segmentation by Filtering with Self-Supervised Geometry and Motion30 May 2024
- 2024FA-Depth: Toward Fast and Accurate Self-supervised Monocular Depth Estimation17 May 2024
- 2024Enhancing AI Diagnostics: Autonomous Lesion Masking via Semi-Supervised Deep Learning18 Apr 2024
- 2023Towards Dynamic and Small Objects Refinement for Unsupervised Domain Adaptative Nighttime Semantic Segmentation7 Oct 2023
- 2023MoDA: Leveraging Motion Priors from Videos for Advancing Unsupervised Domain Adaptation in Semantic Segmentation21 Sep 2023
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimation29 Jun 2023
12 newest of 31 All 31 (JSON)