Good Semi-supervised Learning that Requires a Bad GAN
Not on the map. Why?
Abstract (arXiv)
Semi-supervised learning methods based on generative adversarial networks (GANs) obtained strong empirical results, but it is not clear 1) how the discriminator benefits from joint training with a generator, and 2) why good semi-supervised classification performance and a good generator cannot be obtained at the same time. Theoretically, we show that given the discriminator objective, good semisupervised learning indeed requires a bad generator, and propose the definition of a preferred generator. Empirically, we derive a novel formulation based on our analysis that substantially improves over feature matching GANs, obtaining state-of-the-art results on multiple benchmark datasets.
Key facts. Cited by 85 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 May 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 28; 2022: 22; 2023: 15; 2024: 11; 2025: 7; 2026: 2.
85 papers.
Sort:
By area:
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
- 2021A Survey on Deep Semi-supervised Learningcited by 250
- 2023A Cookbook of Self-Supervised Learningcited by 248
- 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
- 2021A Comprehensive Survey on Graph Anomaly Detection with Deep Learningcited by 230
- 2021Adversarial Reciprocal Points Learning for Open Set Recognitioncited by 153
- 2021Semi-supervised Semantic Segmentation with Directional Context-aware Consistencycited by 112
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2022USB: A Unified Semi-supervised Learning Benchmark for Classificationcited by 95
- 2022Synthetic Data -- what, why and how?cited by 66
- 2024Diffusion Models, Image Super-Resolution And Everything: A Surveycited by 63
38 more
- 2022Debiased Self-Training for Semi-Supervised Learningcited by 62
- 2022BoostMIS: Boosting Medical Image Semi-supervised Learning with Adaptive Pseudo Labeling and Informative Active Annotationcited by 54
- 2021CLDA: Contrastive Learning for Semi-Supervised Domain Adaptationcited by 52
- 2022Semi-Supervised and Unsupervised Deep Visual Learning: A Surveycited by 52
- 2023Diffusion Models With Learned Adaptive Noisecited by 50
- 2021SemiFL: Semi-Supervised Federated Learning for Unlabeled Clients with Alternate Trainingcited by 45
- 2024Memory Consolidation Enables Long-Context Video Understandingcited by 45
- 2023Diffusion Models and Semi-Supervised Learners Benefit Mutually with Few Labelscited by 37
- 2021ECACL: A Holistic Framework for Semi-Supervised Domain Adaptationcited by 31
- 2022Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysiscited by 29
- 2023Pseudo Label-Guided Model Inversion Attack via Conditional Generative Adversarial Networkcited by 28
- 2021Removing Undesirable Feature Contributions Using Out-of-Distribution Datacited by 23
- 2022MutexMatch: Semi-Supervised Learning with Mutex-Based Consistency Regularizationcited by 22
- 2021Medical Image Segmentation with Limited Supervision: A Review of Deep Network Modelscited by 21
- 2024Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent Circumventioncited by 21
- 2023Neural Diffusion Modelscited by 20
- 2023Pseudo-label Alignment for Semi-supervised Instance Segmentationcited by 17
- 2021Generative Adversarial Networks: A Survey Towards Private and Secure Applicationscited by 15
- 2021Credal Self-Supervised Learningcited by 15
- 2025GOLD: Graph Out-of-Distribution Detection via Implicit Adversarial Latent Generationcited by 15
- 2023SemiReward: A General Reward Model for Semi-supervised Learningcited by 14
- 2021RLAD: Time Series Anomaly Detection through Reinforcement Learning and Active Learningcited by 13
- 2022A review of Generative Adversarial Networks for Electronic Health Records: applications, evaluation measures and data sourcescited by 13
- 2021Semi-Supervised Semantic Segmentation of Vessel Images using Leaking Perturbationscited by 12
- 2021A Comparative Review of Recent Few-Shot Object Detection Algorithmscited by 10
- 2023Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approachcited by 10
- 2024Computer Vision for Primate Behavior Analysis in the Wildcited by 10
- 2022RareGAN: Generating Samples for Rare Classescited by 9
- 2021Training Federated GANs with Theoretical Guarantees: A Universal Aggregation Approachcited by 8
- 2022Semi-supervised Deep Learning for Image Classification with Distribution Mismatch: A Surveycited by 8
- 2024Mutual Information Guided Backdoor Mitigation for Pre-trained Encoderscited by 8
- 2021Probabilistic Contrastive Learning for Domain Adaptationcited by 7
- 2024Adversarial Training: A Surveycited by 6
- 2022Reconstruction-Aware Prior Distillation for Semi-supervised Point Cloud Completioncited by 5
- 2022Multi-Granularity Distillation Scheme Towards Lightweight Semi-Supervised Semantic Segmentationcited by 5
- 2024Interleaving One-Class and Weakly-Supervised Models with Adaptive Thresholding for Unsupervised Video Anomaly Detectioncited by 5
- 2022OSSGAN: Open-Set Semi-Supervised Image Generationcited by 4
- 2023Meta-DM: Applications of Diffusion Models on Few-Shot Learningcited by 4
50 most cited of 85 All 85 (JSON)
- 2026Population-Based Multi-Objective Training of Discriminators for Semi-Supervised GANs2 Jul 2026
- 2026Uncertainty-Guided Edge Learning for Deep Image Regression in Remote Sensing7 May 2026
- 2025Semi-Supervised Learning under General Causal Models26 Oct 2025
- 2025Reevaluating Convolutional Neural Networks for Spectral Analysis: A Focus on Raman Spectroscopy30 Sep 2025
- 2025SPARSE Data, Rich Results: Few-Shot Semi-Supervised Learning via Class-Conditioned Image Translation8 Aug 2025
- 2025Joint-stochastic-approximation Random Fields with Application to Semi-supervised Learning24 May 2025
- 2025Joint-stochastic-approximation Autoencoders with Application to Semi-supervised Learning24 May 2025
- 2025ScarceGAN: Discriminative Classification Framework for Rare Class Identification for Longitudinal Data with Weak Prior2 May 2025
- 2025GOLD: Graph Out-of-Distribution Detection via Implicit Adversarial Latent Generation9 Feb 2025
- 2024Adversarial Training: A Survey19 Oct 2024
- 2024Learning Privacy-Preserving Student Networks via Discriminative-Generative Distillation4 Sep 2024
- 2024Depth-Guided Semi-Supervised Instance Segmentation25 Jun 2024
38 more
- 2024GANetic Loss for Generative Adversarial Networks with a Focus on Medical Applications7 Jun 2024
- 2024Mutual Information Guided Backdoor Mitigation for Pre-trained Encoders5 Jun 2024
- 2024Exploiting Autoencoder's Weakness to Generate Pseudo Anomalies9 May 2024
- 2024Real Risks of Fake Data: Synthetic Data, Diversity-Washing and Consent Circumvention3 May 2024
- 2024Memory Consolidation Enables Long-Context Video Understanding8 Feb 2024
- 2024Computer Vision for Primate Behavior Analysis in the Wild29 Jan 2024
- 2024Interleaving One-Class and Weakly-Supervised Models with Adaptive Thresholding for Unsupervised Video Anomaly Detection24 Jan 2024
- 2024Diffusion Models, Image Super-Resolution And Everything: A Survey1 Jan 2024
- 2023Diffusion Models With Learned Adaptive Noise20 Dec 2023
- 2023Video Anomaly Detection via Spatio-Temporal Pseudo-Anomaly Generation : A Unified Approach27 Nov 2023
- 2023An Initialization Schema for Neuronal Networks on Tabular Data7 Nov 2023
- 2023Neural Diffusion Models12 Oct 2023
- 2023SemiReward: A General Reward Model for Semi-supervised Learning4 Oct 2023
- 2023Generative Semi-supervised Learning with Meta-Optimized Synthetic Samples28 Sep 2023
- 2023Pseudo-label Alignment for Semi-supervised Instance Segmentation10 Aug 2023
- 2023Boundary-Refined Prototype Generation: A General End-to-End Paradigm for Semi-Supervised Semantic Segmentation19 Jul 2023
- 2023CASUAL: Conditional Support Alignment for Domain Adaptation with Label Shift29 May 2023
- 2023Meta-DM: Applications of Diffusion Models on Few-Shot Learning14 May 2023
- 2023A Sea-Land Clutter Classification Framework for Over-the-Horizon-Radar Based on Weighted Loss Semi-supervised GAN6 May 2023
- 2023A Cookbook of Self-Supervised Learning24 Apr 2023
- 2023On the link between generative semi-supervised learning and generative open-set recognition21 Mar 2023
- 2023Diffusion Models and Semi-Supervised Learners Benefit Mutually with Few Labels21 Feb 2023
- 2023Pseudo Label-Guided Model Inversion Attack via Conditional Generative Adversarial Network20 Feb 2023
- 2022Gradient Imitation Reinforcement Learning for General Low-Resource Information Extraction11 Nov 2022
- 2022Smooth image-to-image translations with latent space interpolations3 Oct 2022
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep 2022
- 2022Semi-Supervised and Unsupervised Deep Visual Learning: A Survey24 Aug 2022
- 2022Multi-Granularity Distillation Scheme Towards Lightweight Semi-Supervised Semantic Segmentation22 Aug 2022
- 2022Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysis18 Aug 2022
- 2022USB: A Unified Semi-supervised Learning Benchmark for Classification12 Aug 2022
- 2022Complementing Semi-Supervised Learning with Uncertainty Quantification22 Jul 2022
- 2022ExoSGAN and ExoACGAN: Exoplanet Detection using Adversarial Training Algorithms20 Jul 2022
- 2022Deep Low-Density Separation for Semi-Supervised Classification22 May 2022
- 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learning15 May 2022
- 2022Synthetic Data -- what, why and how?6 May 2022
- 2022OSSGAN: Open-Set Semi-Supervised Image Generation29 Apr 2022
- 2022Reconstruction-Aware Prior Distillation for Semi-supervised Point Cloud Completion20 Apr 2022
- 2022MutexMatch: Semi-Supervised Learning with Mutex-Based Consistency Regularization27 Mar 2022
50 newest of 85 All 85 (JSON)
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applicationscited by 1,107
- 2021Maximum Likelihood Training of Score-Based Diffusion Modelscited by 670
- 2024Diffusion Models, Image Super-Resolution And Everything: A Surveycited by 63
- 2023Diffusion Models With Learned Adaptive Noisecited by 50
- 2023Diffusion Models and Semi-Supervised Learners Benefit Mutually with Few Labelscited by 37
- 2023Neural Diffusion Modelscited by 20
- 2023Meta-DM: Applications of Diffusion Models on Few-Shot Learningcited by 4
- 2024Diffusion Models, Image Super-Resolution And Everything: A Survey1 Jan 2024
- 2023Diffusion Models With Learned Adaptive Noise20 Dec 2023
- 2023Neural Diffusion Models12 Oct 2023
- 2023Meta-DM: Applications of Diffusion Models on Few-Shot Learning14 May 2023
- 2023Diffusion Models and Semi-Supervised Learners Benefit Mutually with Few Labels21 Feb 2023
- 2022Diffusion Models: A Comprehensive Survey of Methods and Applications2 Sep 2022
- 2021Maximum Likelihood Training of Score-Based Diffusion Models22 Jan 2021
- 2021A Survey on Deep Semi-supervised Learningcited by 250
- 2023A Cookbook of Self-Supervised Learningcited by 248
- 2022FreeMatch: Self-adaptive Thresholding for Semi-supervised Learningcited by 232
- 2021A Comprehensive Survey on Graph Anomaly Detection with Deep Learningcited by 230
- 2021Adversarial Reciprocal Points Learning for Open Set Recognitioncited by 153
- 2021Semi-supervised Semantic Segmentation with Directional Context-aware Consistencycited by 112
- 2021Recent advances and clinical applications of deep learning in medical image analysiscited by 104
- 2022USB: A Unified Semi-supervised Learning Benchmark for Classificationcited by 95
- 2022Synthetic Data -- what, why and how?cited by 66
- 2022Debiased Self-Training for Semi-Supervised Learningcited by 62
- 2022BoostMIS: Boosting Medical Image Semi-supervised Learning with Adaptive Pseudo Labeling and Informative Active Annotationcited by 54
- 2021CLDA: Contrastive Learning for Semi-Supervised Domain Adaptationcited by 52
12 most cited of 76 All 76 (JSON)
- 2026Population-Based Multi-Objective Training of Discriminators for Semi-Supervised GANs2 Jul 2026
- 2026Uncertainty-Guided Edge Learning for Deep Image Regression in Remote Sensing7 May 2026
- 2025Semi-Supervised Learning under General Causal Models26 Oct 2025
- 2025Reevaluating Convolutional Neural Networks for Spectral Analysis: A Focus on Raman Spectroscopy30 Sep 2025
- 2025SPARSE Data, Rich Results: Few-Shot Semi-Supervised Learning via Class-Conditioned Image Translation8 Aug 2025
- 2025Joint-stochastic-approximation Random Fields with Application to Semi-supervised Learning24 May 2025
- 2025Joint-stochastic-approximation Autoencoders with Application to Semi-supervised Learning24 May 2025
- 2025ScarceGAN: Discriminative Classification Framework for Rare Class Identification for Longitudinal Data with Weak Prior2 May 2025
- 2025GOLD: Graph Out-of-Distribution Detection via Implicit Adversarial Latent Generation9 Feb 2025
- 2024Adversarial Training: A Survey19 Oct 2024
- 2024Learning Privacy-Preserving Student Networks via Discriminative-Generative Distillation4 Sep 2024
- 2024Depth-Guided Semi-Supervised Instance Segmentation25 Jun 2024
12 newest of 76 All 76 (JSON)