Confidence Regularized Self-Training
Not on the map. Why?
Abstract (arXiv)
Recent advances in domain adaptation show that deep self-training presents a powerful means for unsupervised domain adaptation. These methods often involve an iterative process of predicting on target domain and then taking the confident predictions as pseudo-labels for retraining. However, since pseudo-labels can be noisy, self-training can put overconfident label belief on wrong classes, leading to deviated solutions with propagated errors. To address the problem, we propose a confidence regularized self-training (CRST) framework, formulated as regularized self-training. Our method treats pseudo-labels as continuous latent variables jointly optimized via alternating optimization. We propose two types of confidence regularization: label regularization (LR) and model regularization (MR). CRST-LR generates soft pseudo-labels while CRST-MR encourages the smoothness on network output. Extensive experiments on image classification and semantic segmentation show that CRSTs outperform their non-regularized counterpart with state-of-the-art performance. The code and models of this work are available at https://github.com/yzou2/CRST.
Key facts. Cited by 419 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Aug 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 126; 2022: 109; 2023: 98; 2024: 46; 2025: 28; 2026: 12.
419 papers.
Sort:
By area:
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 300
- 2021Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentationcited by 268
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 261
- 2021ST++: Make Self-training Work Better for Semi-supervised Semantic Segmentationcited by 184
- 2021FSDR: Frequency Space Domain Randomization for Domain Generalizationcited by 164
- 2022HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentationcited by 164
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 159
- 2021Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Datacited by 152
- 2021Self-supervised Augmentation Consistency for Adapting Semantic Segmentationcited by 149
- 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 145
- 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 138
- 2021CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptationcited by 129
38 more
- 2021Cycle Self-Training for Domain Adaptationcited by 120
- 2021Learning to Track with Object Permanencecited by 119
- 2022Robust Mean Teacher for Continual and Gradual Test-Time Adaptationcited by 104
- 2022Test-Time Adaptation via Conjugate Pseudo-labelscited by 98
- 2022Deep Unsupervised Domain Adaptation: A Review of Recent Advances and Perspectivescited by 98
- 2023Dual Memory Units with Uncertainty Regulation for Weakly Supervised Video Anomaly Detectioncited by 90
- 2022SePiCo: Semantic-Guided Pixel Contrast for Domain Adaptive Semantic Segmentationcited by 87
- 2022Self-Training: A Surveycited by 86
- 2021Generalize then Adapt: Source-Free Domain Adaptive Semantic Segmentationcited by 81
- 2021Bootstrapping Semantic Segmentation with Regional Contrastcited by 80
- 2021Domain Adaptive Semantic Segmentation with Self-Supervised Depth Estimationcited by 80
- 2021PixMatch: Unsupervised Domain Adaptation via Pixelwise Consistency Trainingcited by 80
- 2021Context-Aware Mixup for Domain Adaptive Semantic Segmentationcited by 79
- 2021Re-distributing Biased Pseudo Labels for Semi-supervised Semantic Segmentation: A Baseline Investigationcited by 78
- 2021Transfer Learning from Synthetic to Real LiDAR Point Cloud for Semantic Segmentationcited by 76
- 2022MM-TTA: Multi-Modal Test-Time Adaptation for 3D Semantic Segmentationcited by 76
- 2022PolarMix: A General Data Augmentation Technique for LiDAR Point Cloudscited by 74
- 2022Bending Reality: Distortion-aware Transformers for Adapting to Panoramic Semantic Segmentationcited by 72
- 2021Category Contrast for Unsupervised Domain Adaptation in Visual Taskscited by 65
- 2023Universal Test-time Adaptation through Weight Ensembling, Diversity Weighting, and Prior Correctioncited by 65
- 2022Safe Self-Refinement for Transformer-based Domain Adaptationcited by 61
- 2022PODA: Prompt-driven Zero-shot Domain Adaptationcited by 60
- 2021ST3D++: Denoised Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 57
- 2021Towards Fewer Annotations: Active Learning via Region Impurity and Prediction Uncertainty for Domain Adaptive Semantic Segmentationcited by 57
- 2022CoSMix: Compositional Semantic Mix for Domain Adaptation in 3D LiDAR Segmentationcited by 54
- 2021Test-time Batch Statistics Calibration for Covariate Shiftcited by 50
- 2023C-SFDA: A Curriculum Learning Aided Self-Training Framework for Efficient Source Free Domain Adaptationcited by 50
- 2021RDA: Robust Domain Adaptation via Fourier Adversarial Attackingcited by 48
- 2021Learning Cross-modal Contrastive Features for Video Domain Adaptationcited by 47
- 2022Class-Balanced Pixel-Level Self-Labeling for Domain Adaptive Semantic Segmentationcited by 47
- 2022Exploiting Completeness and Uncertainty of Pseudo Labels for Weakly Supervised Video Anomaly Detectioncited by 47
- 2023Both Style and Distortion Matter: Dual-Path Unsupervised Domain Adaptation for Panoramic Semantic Segmentationcited by 47
- 2021Sparse-to-dense Feature Matching: Intra and Inter domain Cross-modal Learning in Domain Adaptation for 3D Semantic Segmentationcited by 46
- 2022Behind Every Domain There is a Shift: Adapting Distortion-aware Vision Transformers for Panoramic Semantic Segmentationcited by 46
- 20233D Semantic Segmentation in the Wild: Learning Generalized Models for Adverse-Condition Point Cloudscited by 46
- 2021Improved Regularization and Robustness for Fine-tuning in Neural Networkscited by 45
- 2021Federated Multi-Target Domain Adaptationcited by 44
- 2021Tune it the Right Way: Unsupervised Validation of Domain Adaptation via Soft Neighborhood Densitycited by 44
50 most cited of 419 All 419 (JSON)
- 2026ICM: Intra-class Mixing for Domain Adaptation in Adverse Weather23 Sep 2026
- 2026Balanced Prompt Adaptation against Entropy-Induced Collapse for Test-Time Binary Segmentation18 Sep 2026
- 2026Vision-Language-Guided Pseudo-Labels for Unsupervised Domain Adaptation in Semantic Segmentation for Waste Sorting1 Sep 2026
- 2026APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms29 Jun 2026
- 2026Spatially Selective Self-Training for Unsupervised Building Change Detection9 Jun 2026
- 2026Collaborative Learning for Semi-Supervised LiDAR Semantic Segmentation16 May 2026
- 2026PAS: Estimating the target accuracy before domain adaptation10 Apr 2026
- 2026Why Invariance is Not Enough for Biomedical Domain Generalization and How to Fix It2 Apr 2026
- 2026Denoise and Align: Towards Source-Free UDA for Robust Panoramic Semantic Segmentation26 Mar 2026
- 2026Transfer learning via interpolating structures23 Mar 2026
- 2026Unsupervised Adaptation from FDG to PSMA PET/CT for 3D Lesion Detection under Label Shift14 Mar 2026
- 2026CrossEarth-SAR: A SAR-Centric and Billion-Scale Geospatial Foundation Model for Domain Generalizable Semantic Segmentation12 Mar 2026
38 more
- 2025Improvise, Adapt, Overcome -- Telescopic Adapters for Efficient Fine-tuning of Vision Language Models in Medical Imaging15 Dec 2025
- 2025OMUDA: Omni-level Masking for Unsupervised Domain Adaptation in Semantic Segmentation13 Dec 2025
- 2025Instance-Aware Test-Time Segmentation for Continual Domain Shifts9 Dec 2025
- 2025Balanced Learning for Domain Adaptive Semantic Segmentation7 Dec 2025
- 2025Boosting Unsupervised Video Instance Segmentation with Automatic Quality-Guided Self-Training7 Dec 2025
- 2025TCSA-UDA: Text-Driven Cross-Semantic Alignment for Unsupervised Domain Adaptation in Medical Image Segmentation8 Nov 2025
- 2025Decoupled Entropy Minimization5 Nov 2025
- 2025DPGLA: Bridging the Gap between Synthetic and Real Data for Unsupervised Domain Adaptation in 3D LiDAR Semantic Segmentation27 Oct 2025
- 2025Gradient Enhanced Self-Training Physics-Informed Neural Network (gST-PINN) for Solving Nonlinear Partial Differential Equations12 Oct 2025
- 2025Through the Perspective of LiDAR: A Feature-Enriched and Uncertainty-Aware Annotation Pipeline for Terrestrial Point Cloud Segmentation8 Oct 2025
- 2025Enhancing Pseudo-Boxes via Data-Level LiDAR-Camera Fusion for Unsupervised 3D Object Detection28 Aug 2025
- 2025Feature-Space Planes Searcher: A Universal Domain Adaptation Framework for Interpretability and Computational Efficiency26 Aug 2025
- 2025Learning with Confidence14 Aug 2025
- 2025Dual form Complementary Masking for Domain-Adaptive Image Segmentation16 Jul 2025
- 2025Prototypical Progressive Alignment and Reweighting for Generalizable Semantic Segmentation16 Jul 2025
- 2025Prmpt2Adpt: Prompt-Based Zero-Shot Domain Adaptation for Resource-Constrained Environments20 Jun 2025
- 2025Heterogeneous-Modal Unsupervised Domain Adaptation via Latent Space Bridging19 Jun 2025
- 2025Universal Domain Adaptation for Semantic Segmentation28 May 2025
- 2025Certainty and Uncertainty Guided Active Domain Adaptation26 May 2025
- 2025Using Foundation Models as Pseudo-Label Generators for Pre-Clinical 4D Cardiac CT Segmentation14 May 2025
- 2025Exploring Modality Guidance to Enhance VFM-based Feature Fusion for UDA in 3D Semantic Segmentation19 Apr 2025
- 2025DUDA: Distilled Unsupervised Domain Adaptation for Lightweight Semantic Segmentation14 Apr 2025
- 2025Semantic Library Adaptation: LoRA Retrieval and Fusion for Open-Vocabulary Semantic Segmentation27 Mar 2025
- 2025COARSE: Collaborative Pseudo-Labeling with Coarse Real Labels for Off-Road Semantic Segmentation5 Mar 2025
- 2025Empowering Sparse-Input Neural Radiance Fields with Dual-Level Semantic Guidance from Dense Novel Views4 Mar 2025
- 2025A Unified Framework for Heterogeneous Semi-supervised Learning1 Mar 2025
- 2025Model Adaptation: Unsupervised Domain Adaptation without Source Data26 Feb 2025
- 2025Stein Discrepancy for Unsupervised Domain Adaptation5 Feb 2025
- 2024Contrastive Conditional Alignment based on Label Shift Calibration for Imbalanced Domain Adaptation29 Dec 2024
- 2024Maintain Plasticity in Long-timescale Continual Test-time Adaptation28 Dec 2024
- 2024CrackUDA: Incremental Unsupervised Domain Adaptation for Improved Crack Segmentation in Civil Structures20 Dec 2024
- 2024Rethinking Chain-of-Thought from the Perspective of Self-Training14 Dec 2024
- 2024AH-OCDA: Amplitude-based Curriculum Learning and Hopfield Segmentation Model for Open Compound Domain Adaptation3 Dec 2024
- 2024Multi-Task Label Discovery via Hierarchical Task Tokens for Partially Annotated Dense Predictions27 Nov 2024
- 2024Theory-inspired Label Shift Adaptation via Aligned Distribution Mixture4 Nov 2024
- 2024Domain Adaptation with a Single Vision-Language Embedding28 Oct 2024
- 2024SiamSeg: Self-Training with Contrastive Learning for Unsupervised Domain Adaptation Semantic Segmentation in Remote Sensing17 Oct 2024
- 2024CREAM: Consistency Regularized Self-Rewarding Language Models16 Oct 2024
50 newest of 419 All 419 (JSON)
- 2021Multimodal Knowledge Expansioncited by 26
- 2022Self-Distillation for Unsupervised 3D Domain Adaptationcited by 12
- 2023SLaM: Student-Label Mixing for Distillation with Unlabeled Examplescited by 10
- 2021Unsupervised Domain Expansion for Visual Categorizationcited by 4
- 2024Self-supervised Reflective Learning through Self-distillation and Online Clustering for Speaker Representation Learningcited by 1
- 2024Self-supervised Reflective Learning through Self-distillation and Online Clustering for Speaker Representation Learning3 Jan 2024
- 2023SLaM: Student-Label Mixing for Distillation with Unlabeled Examples8 Feb 2023
- 2022Self-Distillation for Unsupervised 3D Domain Adaptation15 Oct 2022
- 2021Unsupervised Domain Expansion for Visual Categorization1 Apr 2021
- 2021Multimodal Knowledge Expansion26 Mar 2021
- 2022Zero-Shot Text Classification with Self-Trainingcited by 26
- 2023Prompt Ensemble Self-training for Open-Vocabulary Domain Adaptationcited by 1
- 2023Prompt Ensemble Self-training for Open-Vocabulary Domain Adaptation29 Jun 2023
- 2022Zero-Shot Text Classification with Self-Training31 Oct 2022
- 2021DAFormer: Improving Network Architectures and Training Strategies for Domain-Adaptive Semantic Segmentationcited by 300
- 2021Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentationcited by 268
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 261
- 2021ST++: Make Self-training Work Better for Semi-supervised Semantic Segmentationcited by 184
- 2021FSDR: Frequency Space Domain Randomization for Domain Generalizationcited by 164
- 2022HRDA: Context-Aware High-Resolution Domain-Adaptive Semantic Segmentationcited by 164
- 2021ST3D: Self-training for Unsupervised Domain Adaptation on 3D Object Detectioncited by 159
- 2021Model Adaptation: Historical Contrastive Learning for Unsupervised Domain Adaptation without Source Datacited by 152
- 2021Self-supervised Augmentation Consistency for Adapting Semantic Segmentationcited by 149
- 2021Offboard 3D Object Detection from Point Cloud Sequencescited by 145
- 2021MIST: Multiple Instance Self-Training Framework for Video Anomaly Detectioncited by 138
- 2021CDTrans: Cross-domain Transformer for Unsupervised Domain Adaptationcited by 129
12 most cited of 406 All 406 (JSON)
- 2026ICM: Intra-class Mixing for Domain Adaptation in Adverse Weather23 Sep 2026
- 2026Balanced Prompt Adaptation against Entropy-Induced Collapse for Test-Time Binary Segmentation18 Sep 2026
- 2026Vision-Language-Guided Pseudo-Labels for Unsupervised Domain Adaptation in Semantic Segmentation for Waste Sorting1 Sep 2026
- 2026APRIL-MedSeg: A Modular Medical Image Segmentation Toolbox Embracing Modern Paradigms29 Jun 2026
- 2026Spatially Selective Self-Training for Unsupervised Building Change Detection9 Jun 2026
- 2026Collaborative Learning for Semi-Supervised LiDAR Semantic Segmentation16 May 2026
- 2026PAS: Estimating the target accuracy before domain adaptation10 Apr 2026
- 2026Why Invariance is Not Enough for Biomedical Domain Generalization and How to Fix It2 Apr 2026
- 2026Denoise and Align: Towards Source-Free UDA for Robust Panoramic Semantic Segmentation26 Mar 2026
- 2026Transfer learning via interpolating structures23 Mar 2026
- 2026Unsupervised Adaptation from FDG to PSMA PET/CT for 3D Lesion Detection under Label Shift14 Mar 2026
- 2026CrossEarth-SAR: A SAR-Centric and Billion-Scale Geospatial Foundation Model for Domain Generalizable Semantic Segmentation12 Mar 2026
12 newest of 406 All 406 (JSON)