mlsanityData to 7 Oct 2026

Structured prototype regularization for synthetic-to-real driving scene parsing

arXiv 2603.16083 ↗First posted 17 Mar 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Driving scene parsing is critical for autonomous vehicles to operate reliably in complex real-world traffic environments. To reduce the reliance on costly pixel-level annotations, synthetic datasets with automatically generated labels have become a popular alternative. However, models trained on synthetic data often perform poorly when applied to real-world scenes due to the synthetic-to-real domain gap. Despite the success of unsupervised domain adaptation in narrowing this gap, most existing methods mainly focus on global feature alignment while overlooking the semantic structure of the feature space. As a result, semantic relations among classes are insufficiently modeled, limiting the model's ability to generalize. To address these challenges, this study introduces a novel unsupervised domain adaptation framework that explicitly regularizes semantic feature structures to significantly enhance driving scene parsing performance in real-world scenarios. Specifically, the proposed method enforces inter-class separation and intra-class compactness by leveraging class-specific prototypes, thereby enhancing the discriminability and structural coherence of feature clusters. An entropy-based noise filtering strategy improves the reliability of pseudo labels, while a pixel-level attention mechanism further refines feature alignment. Extensive experiments on representative benchmarks demonstrate that the proposed method consistently outperforms recent state-of-the-art methods. These results underscore the importance of preserving semantic structure for robust synthetic-to-real adaptation in driving scene parsing tasks.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 51 of its 85 references that are in the map. First posted on arXiv 17 Mar 2026.

Builds on

51 of 85 references.

References · 51

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  3. 2020A Simple Framework for Contrastive Learning of Visual Representationscited by 11,979
  4. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  5. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  6. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  7. 2015Learning Transferable Features with Deep Adaptation Networkscited by 1,323
  8. 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
  9. 2016Playing for Data: Ground Truth from Computer Gamescited by 816
  10. 2018ADVENT: Adversarial Entropy Minimization for Domain Adaptation in Semantic Segmentationcited by 623
  11. 2018Learning to Adapt Structured Output Space for Semantic Segmentationcited by 584
  12. 2019Bidirectional Learning for Domain Adaptation of Semantic Segmentationcited by 308
38 more
  1. 2021Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentationcited by 268
  2. 2016FCNs in the Wild: Pixel-level Adversarial and Constraint-based Adaptationcited by 242
  3. 2020DACS: Domain Adaptation via Cross-domain Mixed Samplingcited by 226
  4. 2020Rectifying Pseudo Label Learning via Uncertainty Estimation for Domain Adaptive Semantic Segmentationcited by 222
  5. 2020Unsupervised Intra-domain Adaptation for Semantic Segmentation through Self-Supervisioncited by 198
  6. 2020Instance Adaptive Self-Training for Unsupervised Domain Adaptationcited by 177
  7. 2021Source-Free Domain Adaptation for Semantic Segmentationcited by 168
  8. 2020Learning Texture Invariant Representation for Domain Adaptation of Semantic Segmentationcited by 153
  9. 2019Domain Adaptation for Structured Output via Discriminative Patch Representationscited by 150
  10. 2020Classes Matter: A Fine-grained Adversarial Approach to Cross-domain Semantic Segmentationcited by 142
  11. 2021Semi-Supervised Semantic Segmentation with Pixel-Level Contrastive Learning from a Class-wise Memory Bankcited by 125
  12. 2022SePiCo: Semantic-Guided Pixel Contrast for Domain Adaptive Semantic Segmentationcited by 87
  13. 2020Contextual-Relation Consistent Domain Adaptation for Semantic Segmentationcited by 70
  14. 2020SNE-RoadSeg: Incorporating Surface Normal Information into Semantic Segmentation for Accurate Freespace Detectioncited by 66
  15. 2020Domain Adaptive Semantic Segmentation Using Weak Labelscited by 56
  16. 2023C-SFDA: A Curriculum Learning Aided Self-Training Framework for Efficient Source Free Domain Adaptationcited by 49
  17. 2023When Source-Free Domain Adaptation Meets Learning with Noisy Labelscited by 46
  18. 2021MetaCorrection: Domain-aware Meta Loss Correction for Unsupervised Domain Adaptation in Semantic Segmentationcited by 43
  19. 2020Learning from Scale-Invariant Examples for Domain Adaptation in Semantic Segmentationcited by 41
  20. 2022Prototypical Contrast Adaptation for Domain Adaptive Semantic Segmentationcited by 40
  21. 2020Affinity Space Adaptation for Semantic Segmentation Across Domainscited by 31
  22. 2022Refign: Align and Refine for Adaptation of Semantic Segmentation to Adverse Conditionscited by 31
  23. 2023FREDOM: Fairness Domain Adaptation Approach to Semantic Scene Understandingcited by 27
  24. 2023RoadFormer: Duplex Transformer for RGB-Normal Semantic Road Scene Parsingcited by 27
  25. 2020Unsupervised Domain Adaptation for Semantic Segmentation by Content Transfercited by 24
  26. 2020Learning Collision-Free Space Detection from Stereo Images: Homography Matrix Brings Better Data Augmentationcited by 19
  27. 2021Contrastive Learning and Self-Training for Unsupervised Domain Adaptation in Semantic Segmentationcited by 19
  28. 2022SimT: Handling Open-set Noise for Domain Adaptive Semantic Segmentationcited by 17
  29. 2024S3M-Net: Joint Learning of Semantic Segmentation and Stereo Matching for Autonomous Drivingcited by 14
  30. 2022STC: Spatio-Temporal Contrastive Learning for Video Instance Segmentationcited by 13
  31. 2021A Curriculum-style Self-training Approach for Source-Free Semantic Segmentationcited by 10
  32. 2023Towards Source-free Domain Adaptive Semantic Segmentation via Importance-aware and Prototype-contrast Learningcited by 9
  33. 2024RoadFormer+: Delivering RGB-X Scene Parsing through Scale-Aware Information Decoupling and Advanced Heterogeneous Feature Fusioncited by 9
  34. 2024LIX: Implicitly Infusing Spatial Geometric Prior Knowledge into Visual Semantic Segmentation for Autonomous Drivingcited by 8
  35. 2022VBLC: Visibility Boosting and Logit-Constraint Learning for Domain Adaptive Semantic Segmentation under Adverse Conditionscited by 7
  36. 2021Exploiting Inter-pixel Correlations in Unsupervised Domain Adaptation for Semantic Segmentationcited by 4
  37. 2022Exploring High-quality Target Domain Information for Unsupervised Domain Adaptive Semantic Segmentationcited by 4
  38. 2024TiCoSS: Tightening the Coupling between Semantic Segmentation and Stereo Matching within A Joint Learning Frameworkcited by 3

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.