mlsanityData to 7 Oct 2026

LinkGAN: Linking GAN Latents to Pixels for Controllable Image Synthesis

arXiv 2301.04604 ↗First posted 11 Jan 2023cs.CVcited by 15

Not on the map. Why?

Abstract (arXiv)

This work presents an easy-to-use regularizer for GAN training, which helps explicitly link some axes of the latent space to a set of pixels in the synthesized image. Establishing such a connection facilitates a more convenient local control of GAN generation, where users can alter the image content only within a spatial area simply by partially resampling the latent code. Experimental results confirm four appealing properties of our regularizer, which we call LinkGAN. (1) The latent-pixel linkage is applicable to either a fixed region (textiti.e., same for all instances) or a particular semantic category (i.e., varying across instances), like the sky. (2) Two or multiple regions can be independently linked to different latent axes, which further supports joint control. (3) Our regularizer can improve the spatial controllability of both 2D and 3D-aware GAN models, barely sacrificing the synthesis performance. (4) The models trained with our regularizer are compatible with GAN inversion techniques and maintain editability on real images.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 63 of its 69 references that are in the map. First posted on arXiv 11 Jan 2023.

Builds on

63 of 69 references.

References · 63

  1. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  2. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  3. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  4. 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
  5. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
  6. 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,609
  7. 2017Improved Training of Wasserstein GANscited by 2,223
  8. 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,048
  9. 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
  10. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  11. 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,350
  12. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
38 more
  1. 2021Efficient Geometry-aware 3D Generative Adversarial Networkscited by 1,204
  2. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  3. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
  4. 2019StarGAN v2: Diverse Image Synthesis for Multiple Domainscited by 1,095
  5. 2016Semantic Understanding of Scenes through the ADE20K Datasetcited by 1,063
  6. 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,036
  7. 2021StyleCLIP: Text-Driven Manipulation of StyleGAN Imagerycited by 990
  8. 2020GIRAFFE: Representing Scenes as Compositional Generative Neural Feature Fieldscited by 784
  9. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  10. 2018Which Training Methods for GANs do actually Converge?cited by 672
  11. 2020GANSpace: Discovering Interpretable GAN Controlscited by 612
  12. 2020Closed-Form Factorization of Latent Semantics in GANscited by 407
  13. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 393
  14. 2016Generative Visual Manipulation on the Natural Image Manifoldcited by 348
  15. 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 331
  16. 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 288
  17. 2021DatasetGAN: Efficient Labeled Data Factory with Minimal Human Effortcited by 264
  18. 2019On the "steerability" of generative adversarial networkscited by 247
  19. 2019Large Scale Adversarial Representation Learningcited by 238
  20. 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
  21. 2017Neural Style Transfer: A Reviewcited by 199
  22. 2020Editing in Style: Uncovering the Local Semantics of GANscited by 183
  23. 2020BlockGAN: Learning 3D Object-aware Scene Representations from Unlabelled Imagescited by 166
  24. 2021EditGAN: High-Precision Semantic Image Editingcited by 156
  25. 2019Seeing What a GAN Cannot Generatecited by 148
  26. 2021Generative Adversarial Transformerscited by 120
  27. 20213D-aware Image Synthesis via Learning Structural and Textural Representationscited by 109
  28. 2019Semantic Hierarchy Emerges in Deep Generative Representations for Scene Synthesiscited by 106
  29. 2020Rewriting a Deep Generative Modelcited by 105
  30. 2020Controlling generative models with continuous factors of variationscited by 93
  31. 2021GAN-Control: Explicitly Controllable GANscited by 91
  32. 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
  33. 2020The Hessian Penalty: A Weak Prior for Unsupervised Disentanglementcited by 90
  34. 2020Generative Hierarchical Features from Synthesizing Imagescited by 83
  35. 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
  36. 2021LatentCLR: A Contrastive Learning Approach for Unsupervised Discovery of Interpretable Directionscited by 52
  37. 2021Low-Rank Subspaces in GANscited by 52
  38. 2020Navigating the GAN Parameter Space for Semantic Image Editingcited by 49

50 most cited of 63 All 63 (JSON)

Built on by

Cited by year

Citing papers per year: 2023: 7; 2024: 7; 2025: 1.

15 papers.

Sort:

By area:

  1. 2023DragDiffusion: Harnessing Diffusion Models for Interactive Point-based Image Editingcited by 293
  2. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
  3. 2023Control3Diff: Learning Controllable 3D Diffusion Models from Single-view Imagescited by 27
  4. 2024LightningDrag: Lightning Fast and Accurate Drag-based Image Editing Emerging from Videoscited by 18
  5. 2023Learning 3D-aware Image Synthesis with Unknown Pose Distributioncited by 14
  6. 2024GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Imagecited by 12
  7. 2024Generative Artificial Intelligence Meets Synthetic Aperture Radar: A Surveycited by 9
  8. 2023SMaRt: Improving GANs with Score Matching Regularitycited by 6
  9. 2024DA-HFNet: Progressive Fine-Grained Forgery Image Detection and Localization Based on Dual Attentioncited by 4
  10. 2024Diverse and Lifespan Facial Age Transformation Synthesis with Identity Variation Rationality Metriccited by 3
  11. 2024Revealing Directions for Text-guided 3D Face Editingcited by 2
  12. 2023Learning Modulated Transformation in GANscited by 1
3 more
  1. 2023Survey on Controlable Image Synthesis with Deep Learningcited by 0
  2. 2024Multi-task SAR Image Processing via GAN-based Unsupervised Manipulationcited by 0
  3. 2025UCD: Unconditional Discriminator Promotes Nash Equilibrium in GANscited by 0