mlsanityData to 7 Oct 2026

Self-Supervised GANs via Auxiliary Rotation Loss

arXiv 1811.11212 ↗First posted 27 Nov 2018cs.LG cs.CV stat.MLcited by 94

Not on the map. Why?

Abstract (arXiv)

Conditional GANs are at the forefront of natural image synthesis. The main drawback of such models is the necessity for labeled data. In this work we exploit two popular unsupervised learning techniques, adversarial training and self-supervision, and take a step towards bridging the gap between conditional and unconditional GANs. In particular, we allow the networks to collaborate on the task of representation learning, while being adversarial with respect to the classic GAN game. The role of self-supervision is to encourage the discriminator to learn meaningful feature representations which are not forgotten during training. We test empirically both the quality of the learned image representations, and the quality of the synthesized images. Under the same conditions, the self-supervised GAN attains a similar performance to state-of-the-art conditional counterparts. Finally, we show that this approach to fully unsupervised learning can be scaled to attain an FID of 23.4 on unconditional ImageNet generation.

Key facts. Cited by 94 papers in the map (data through 7 Oct 2026). First posted on arXiv 27 Nov 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 35; 2022: 28; 2023: 19; 2024: 8; 2025: 2; 2026: 2.

94 papers.

Sort:

By area:

  1. 2022Generative Adversarial Networkscited by 5,603
  2. 2023Consistency Modelscited by 1,778
  3. 2022MaxViT: Multi-Axis Vision Transformercited by 476
  4. 2021Deep Generative Modelling: A Comparative Review of VAEs, GANs, Normalizing Flows, Energy-Based and Autoregressive Modelscited by 251
  5. 2021Co2L: Contrastive Continual Learningcited by 243
  6. 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 205
  7. 2022Self-supervised Learning of Adversarial Example: Towards Good Generalizations for Deepfake Detectioncited by 172
  8. 2021Towards Faster and Stabilized GAN Training for High-fidelity Few-shot Image Synthesiscited by 140
  9. 2021Towards Discovery and Attribution of Open-world GAN Generated Imagescited by 66
  10. 2021Improved Transformer for High-Resolution GANscited by 59
  11. 2021Data-Efficient Instance Generation from Instance Discriminationcited by 58
  12. 2022Semi-Supervised and Unsupervised Deep Visual Learning: A Surveycited by 52
38 more
  1. 2022Deepfake Network Architecture Attributioncited by 47
  2. 2021DU-GAN: Generative Adversarial Networks with Dual-Domain U-Net Based Discriminators for Low-Dose CT Denoisingcited by 46
  3. 2021Training GANs with Stronger Augmentations via Contrastive Discriminatorcited by 45
  4. 2022QS-Attn: Query-Selected Attention for Contrastive Learning in I2I Translationcited by 39
  5. 2023Know Your Self-supervised Learning: A Survey on Image-based Generative and Discriminative Trainingcited by 39
  6. 2022StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesiscited by 38
  7. 2022Self-Guided Diffusion Modelscited by 36
  8. 2021Dual Contrastive Loss and Attention for GANscited by 30
  9. 2021Continual Learning on Noisy Data Streams via Self-Purified Replaycited by 27
  10. 2021Data-Efficient GAN Training Beyond (Just) Augmentations: A Lottery Ticket Perspectivecited by 25
  11. 2022Self-supervised remote sensing feature learning: Learning Paradigms, Challenges, and Future Workscited by 24
  12. 2021SSTN: Self-Supervised Domain Adaptation Thermal Object Detection for Autonomous Drivingcited by 23
  13. 2021Conditional GANs with Auxiliary Discriminative Classifiercited by 20
  14. 2022Improving GANs with A Dynamic Discriminatorcited by 20
  15. 2023From Google Gemini to OpenAI Q* (Q-Star): A Survey of Reshaping the Generative Artificial Intelligence (AI) Research Landscapecited by 18
  16. 2021Quaternion Generative Adversarial Networkscited by 17
  17. 2024SIRST-5K: Exploring Massive Negatives Synthesis with Self-supervised Learning for Robust Infrared Small Target Detectioncited by 17
  18. 2022A Style-aware Discriminator for Controllable Image Translationcited by 16
  19. 2022Learning Probabilistic Models from Generator Latent Spaces with Hat EBMcited by 11
  20. 2021MetaDelta: A Meta-Learning System for Few-shot Image Classificationcited by 10
  21. 2021Exploring The Effect of High-frequency Components in GANs Trainingcited by 10
  22. 2021Partition-Guided GANscited by 9
  23. 2021Self-Supervised GANs with Label Augmentationcited by 9
  24. 2021BIGRoC: Boosting Image Generation via a Robust Classifiercited by 9
  25. 2022RareGAN: Generating Samples for Rare Classescited by 9
  26. 2021Temporal Knowledge Consistency for Unsupervised Visual Representation Learningcited by 8
  27. 2022Augmentation-Aware Self-Supervision for Data-Efficient GAN Trainingcited by 7
  28. 2022Generator Knows What Discriminator Should Learn in Unconditional GANscited by 7
  29. 2022Unsupervised Learning of Structured Representations via Closed-Loop Transcriptioncited by 7
  30. 2023Unpaired Image-to-Image Translation with Limited Data to Reveal Subtle Phenotypescited by 7
  31. 2021Edge-Enhanced Dual Discriminator Generative Adversarial Network for Fast MRI with Parallel Imaging Using Multi-view Informationcited by 6
  32. 2022Towards Efficient and Effective Self-Supervised Learning of Visual Representationscited by 6
  33. 2023Multi-Task Self-Supervised Time-Series Representation Learningcited by 6
  34. 2024Exploring Privacy and Fairness Risks in Sharing Diffusion Models: An Adversarial Perspectivecited by 6
  35. 2021The emergence of visual semantics through communication gamescited by 5
  36. 2021Generative Convolution Layer for Image Generationcited by 5
  37. 2022Transfer of Representations to Video Label Propagation: Implementation Factors Mattercited by 5
  38. 2024Self-Supervised Learning with Generative Adversarial Networks for Electron Microscopycited by 5

50 most cited of 94 All 94 (JSON)