SPIGAN: Privileged Adversarial Learning from Simulation
Not on the map. Why?
Abstract (arXiv)
Deep Learning for Computer Vision depends mainly on the source of supervision.Photo-realistic simulators can generate large-scale automatically labeled syntheticdata, but introduce a domain gap negatively impacting performance. We propose anew unsupervised domain adaptation algorithm, called SPIGAN, relying on Sim-ulator Privileged Information (PI) and Generative Adversarial Networks (GAN).We use internal data from the simulator as PI during the training of a target tasknetwork. We experimentally evaluate our approach on semantic segmentation. Wetrain the networks on real-world Cityscapes and Vistas datasets, using only unla-beled real-world images and synthetic labeled data with z-buffer (depth) PI fromthe SYNTHIA dataset. Our method improves over no adaptation and state-of-the-art unsupervised domain adaptation techniques.
Key facts. Cited by 47 papers in the map (data through 7 Oct 2026). First posted on arXiv 9 Oct 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 7; 2023: 12; 2024: 8; 2025: 3; 2026: 1.
47 papers.
Sort:
By area:
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 299
- 2022HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentationcited by 163
- 2021Learning to Track with Object Permanencecited by 117
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 100
- 2021Domain Adaptive Semantic Segmentation with Self-Supervised Depth Estimationcited by 80
- 2021Cross-modal Learning for Domain Adaptation in 3D Semantic Segmentationcited by 40
- 2021Geometric Unsupervised Domain Adaptation for Semantic Segmentationcited by 33
- 2021Learning to Relate Depth and Semantics for Unsupervised Domain Adaptationcited by 32
- 2021BiMaL: Bijective Maximum Likelihood Approach to Domain Adaptation in Semantic Scene Segmentationcited by 31
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approachescited by 30
- 2023Survey on Unsupervised Domain Adaptation for Semantic Segmentation for Visual Perception in Automated Drivingcited by 29
- 2023FREDOM: Fairness Domain Adaptation Approach to Semantic Scene Understandingcited by 27
35 more
- 2023Semantic Image Segmentation: Two Decades of Researchcited by 26
- 2021Improving Semi-Supervised and Domain-Adaptive Semantic Segmentation with Self-Supervised Depth Estimationcited by 25
- 2021Multi-Target Adversarial Frameworks for Domain Adaptation in Semantic Segmentationcited by 16
- 2021Mutually improved endoscopic image synthesis and landmark detection in unpaired image-to-image translationcited by 15
- 2021Plugging Self-Supervised Monocular Depth into Unsupervised Domain Adaptation for Semantic Segmentationcited by 13
- 2024MICDrop: Masking Image and Depth Features via Complementary Dropout for Domain-Adaptive Semantic Segmentationcited by 13
- 2021Maximizing Cosine Similarity Between Spatial Features for Unsupervised Domain Adaptation in Semantic Segmentationcited by 12
- 2022Continual BatchNorm Adaptation (CBNA) for Semantic Segmentationcited by 12
- 2021Rethinking Ensemble-Distillation for Semantic Segmentation Based Unsupervised Domain Adaptationcited by 11
- 2022CONDA: Continual Unsupervised Domain Adaptation Learning in Visual Perception for Self-Driving Carscited by 11
- 2023Augmentation-based Domain Generalization for Semantic Segmentationcited by 10
- 2023Transferring to Real-World Layouts: A Depth-aware Framework for Scene Adaptationcited by 9
- 2024EAGLE: Efficient Adaptive Geometry-based Learning in Cross-view Understandingcited by 6
- 2024Towards Interpretable Physical-Conceptual Catchment-Scale Hydrological Modeling using the Mass-Conserving-Perceptroncited by 4
- 2024Language-Guided Instance-Aware Domain-Adaptive Panoptic Segmentationcited by 4
- 2022Geometry-Aware Network for Domain Adaptive Semantic Segmentationcited by 3
- 2021Unsupervised Domain Adaptation from Axial to Short-Axis Multi-Slice Cardiac MR Images by Incorporating Pretrained Task Networkscited by 2
- 2021Improving Online Performance Prediction for Semantic Segmentationcited by 2
- 2023Learning Good Features to Transfer Across Tasks and Domainscited by 2
- 2023CROVIA: Seeing Drone Scenes from Car Perspective via Cross-View Adaptationcited by 2
- 2023CoMaL: Conditional Maximum Likelihood Approach to Self-supervised Domain Adaptation in Long-tail Semantic Segmentationcited by 2
- 2022Depth-Assisted ResiDualGAN for Cross-Domain Aerial Images Semantic Segmentationcited by 1
- 2023HazardNet: Road Debris Detection by Augmentation of Synthetic Modelscited by 1
- 2023Robust Unsupervised Domain Adaptation by Retaining Confident Entropy via Edge Concatenationcited by 1
- 2024Energy-based Domain-Adaptive Segmentation with Depth Guidancecited by 1
- 2025Post-Convergence Sim-to-Real Policy Transfer: A Principled Alternative to Cherry-Pickingcited by 1
- 2025Sim2Real in endoscopy segmentation with a novel structure aware image translationcited by 1
- 2026PEPR: Privileged Event-based Predictive Regularization for Domain Generalizationcited by 1
- 2022Knowledge-Integrated Informed AI for National Securitycited by 0
- 2022ELDA: Using Edges to Have an Edge on Semantic Segmentation Based UDAcited by 0
- 2023Regularizing Self-training for Unsupervised Domain Adaptation via Structural Constraintscited by 0
- 2024Machine learning-based optimization workflow of the homogeneity of spunbond nonwovens with human validationcited by 0
- 2024Output-Constrained Decision Treescited by 0
- 2024A Study on Unsupervised Domain Adaptation for Semantic Segmentation in the Era of Vision-Language Modelscited by 0
- 2025Depth-Sensitive Soft Suppression with RGB-D Inter-Modal Stylization Flow for Domain Generalization Semantic Segmentationcited by 0
- 2026PEPR: Privileged Event-based Predictive Regularization for Domain Generalization4 Feb 2026
- 2025Depth-Sensitive Soft Suppression with RGB-D Inter-Modal Stylization Flow for Domain Generalization Semantic Segmentation11 May 2025
- 2025Sim2Real in endoscopy segmentation with a novel structure aware image translation5 May 2025
- 2025Post-Convergence Sim-to-Real Policy Transfer: A Principled Alternative to Cherry-Picking21 Apr 2025
- 2024A Study on Unsupervised Domain Adaptation for Semantic Segmentation in the Era of Vision-Language Models25 Nov 2024
- 2024MICDrop: Masking Image and Depth Features via Complementary Dropout for Domain-Adaptive Semantic Segmentation29 Aug 2024
- 2024EAGLE: Efficient Adaptive Geometry-based Learning in Cross-view Understanding3 Jun 2024
- 2024Output-Constrained Decision Trees24 May 2024
- 2024Machine learning-based optimization workflow of the homogeneity of spunbond nonwovens with human validation15 Apr 2024
- 2024Language-Guided Instance-Aware Domain-Adaptive Panoptic Segmentation4 Apr 2024
- 2024Energy-based Domain-Adaptive Segmentation with Depth Guidance6 Feb 2024
- 2024Towards Interpretable Physical-Conceptual Catchment-Scale Hydrological Modeling using the Mass-Conserving-Perceptron25 Jan 2024
35 more
- 2023Transferring to Real-World Layouts: A Depth-aware Framework for Scene Adaptation21 Nov 2023
- 2023Robust Unsupervised Domain Adaptation by Retaining Confident Entropy via Edge Concatenation11 Oct 2023
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimation29 Jun 2023
- 2023Regularizing Self-training for Unsupervised Domain Adaptation via Structural Constraints29 Apr 2023
- 2023Augmentation-based Domain Generalization for Semantic Segmentation24 Apr 2023
- 2023Survey on Unsupervised Domain Adaptation for Semantic Segmentation for Visual Perception in Automated Driving24 Apr 2023
- 2023CoMaL: Conditional Maximum Likelihood Approach to Self-supervised Domain Adaptation in Long-tail Semantic Segmentation14 Apr 2023
- 2023CROVIA: Seeing Drone Scenes from Car Perspective via Cross-View Adaptation14 Apr 2023
- 2023FREDOM: Fairness Domain Adaptation Approach to Semantic Scene Understanding4 Apr 2023
- 2023HazardNet: Road Debris Detection by Augmentation of Synthetic Models14 Mar 2023
- 2023Semantic Image Segmentation: Two Decades of Research13 Feb 2023
- 2023Learning Good Features to Transfer Across Tasks and Domains26 Jan 2023
- 2022Geometry-Aware Network for Domain Adaptive Semantic Segmentation2 Dec 2022
- 2022CONDA: Continual Unsupervised Domain Adaptation Learning in Visual Perception for Self-Driving Cars1 Dec 2022
- 2022ELDA: Using Edges to Have an Edge on Semantic Segmentation Based UDA16 Nov 2022
- 2022Depth-Assisted ResiDualGAN for Cross-Domain Aerial Images Semantic Segmentation21 Aug 2022
- 2022HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentation27 Apr 2022
- 2022Continual BatchNorm Adaptation (CBNA) for Semantic Segmentation2 Mar 2022
- 2022Knowledge-Integrated Informed AI for National Security4 Feb 2022
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentation29 Nov 2021
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approaches11 Nov 2021
- 2021Plugging Self-Supervised Monocular Depth into Unsupervised Domain Adaptation for Semantic Segmentation13 Oct 2021
- 2021Improving Semi-Supervised and Domain-Adaptive Semantic Segmentation with Self-Supervised Depth Estimation28 Aug 2021
- 2021Multi-Target Adversarial Frameworks for Domain Adaptation in Semantic Segmentation16 Aug 2021
- 2021BiMaL: Bijective Maximum Likelihood Approach to Domain Adaptation in Semantic Scene Segmentation6 Aug 2021
- 2021Mutually improved endoscopic image synthesis and landmark detection in unpaired image-to-image translation14 Jul 2021
- 2021Learning to Relate Depth and Semantics for Unsupervised Domain Adaptation17 May 2021
- 2021Rethinking Ensemble-Distillation for Semantic Segmentation Based Unsupervised Domain Adaptation29 Apr 2021
- 2021Domain Adaptive Semantic Segmentation with Self-Supervised Depth Estimation28 Apr 2021
- 2021Improving Online Performance Prediction for Semantic Segmentation12 Apr 2021
- 2021Geometric Unsupervised Domain Adaptation for Semantic Segmentation30 Mar 2021
- 2021Learning to Track with Object Permanence26 Mar 2021
- 2021Maximizing Cosine Similarity Between Spatial Features for Unsupervised Domain Adaptation in Semantic Segmentation25 Feb 2021
- 2021Unsupervised Domain Adaptation from Axial to Short-Axis Multi-Slice Cardiac MR Images by Incorporating Pretrained Task Networks19 Jan 2021
- 2021Cross-modal Learning for Domain Adaptation in 3D Semantic Segmentation18 Jan 2021
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 299
- 2022HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentationcited by 163
- 2021Learning to Track with Object Permanencecited by 117
- 2023Towards Zero-Shot Scale-Aware Monocular Depth Estimationcited by 100
- 2021Domain Adaptive Semantic Segmentation with Self-Supervised Depth Estimationcited by 80
- 2021Cross-modal Learning for Domain Adaptation in 3D Semantic Segmentationcited by 40
- 2021Geometric Unsupervised Domain Adaptation for Semantic Segmentationcited by 33
- 2021Learning to Relate Depth and Semantics for Unsupervised Domain Adaptationcited by 32
- 2021BiMaL: Bijective Maximum Likelihood Approach to Domain Adaptation in Semantic Scene Segmentationcited by 31
- 2021Review of Pedestrian Trajectory Prediction Methods: Comparing Deep Learning and Knowledge-based Approachescited by 30
- 2023Survey on Unsupervised Domain Adaptation for Semantic Segmentation for Visual Perception in Automated Drivingcited by 29
- 2023FREDOM: Fairness Domain Adaptation Approach to Semantic Scene Understandingcited by 27
12 most cited of 46 All 46 (JSON)
- 2026PEPR: Privileged Event-based Predictive Regularization for Domain Generalization4 Feb 2026
- 2025Depth-Sensitive Soft Suppression with RGB-D Inter-Modal Stylization Flow for Domain Generalization Semantic Segmentation11 May 2025
- 2025Sim2Real in endoscopy segmentation with a novel structure aware image translation5 May 2025
- 2025Post-Convergence Sim-to-Real Policy Transfer: A Principled Alternative to Cherry-Picking21 Apr 2025
- 2024MICDrop: Masking Image and Depth Features via Complementary Dropout for Domain-Adaptive Semantic Segmentation29 Aug 2024
- 2024EAGLE: Efficient Adaptive Geometry-based Learning in Cross-view Understanding3 Jun 2024
- 2024Output-Constrained Decision Trees24 May 2024
- 2024Machine learning-based optimization workflow of the homogeneity of spunbond nonwovens with human validation15 Apr 2024
- 2024Language-Guided Instance-Aware Domain-Adaptive Panoptic Segmentation4 Apr 2024
- 2024Energy-based Domain-Adaptive Segmentation with Depth Guidance6 Feb 2024
- 2024Towards Interpretable Physical-Conceptual Catchment-Scale Hydrological Modeling using the Mass-Conserving-Perceptron25 Jan 2024
- 2023Transferring to Real-World Layouts: A Depth-aware Framework for Scene Adaptation21 Nov 2023
12 newest of 46 All 46 (JSON)