Collaborative Learning for Faster StyleGAN Embedding
Not on the map. Why?
Abstract (arXiv)
The latent code of the recent popular model StyleGAN has learned disentangled representations thanks to the multi-layer style-based generator. Embedding a given image back to the latent space of StyleGAN enables wide interesting semantic image editing applications. Although previous works are able to yield impressive inversion results based on an optimization framework, which however suffers from the efficiency issue. In this work, we propose a novel collaborative learning framework that consists of an efficient embedding network and an optimization-based iterator. On one hand, with the progress of training, the embedding network gives a reasonable latent code initialization for the iterator. On the other hand, the updated latent code from the iterator in turn supervises the embedding network. In the end, high-quality latent code can be obtained efficiently with a single forward pass through our embedding network. Extensive experiments demonstrate the effectiveness and efficiency of our work.
Key facts. Cited by 65 papers in the map (data through 7 Oct 2026). First posted on arXiv 3 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 25; 2022: 24; 2023: 12; 2024: 3; 2025: 1.
65 papers.
Sort:
By area:
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2021GAN Inversion: A Surveycited by 366
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
- 2021Paint by Wordcited by 107
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2021HyperInverter: Improving StyleGAN Inversion via Hypernetworkcited by 85
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2022Stitch it in Time: GAN-Based Facial Editing of Real Videoscited by 68
38 more
- 2021Using latent space regression to analyze and leverage compositionality in GANscited by 55
- 2021GAN Inversion for Out-of-Range Images with Geometric Transformationscited by 55
- 2022Third Time's the Charm? Image and Video Editing with StyleGAN3cited by 54
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
- 20223D GAN Inversion with Pose Optimizationcited by 44
- 2023TriPlaneNet: An Encoder for EG3D Inversioncited by 41
- 2021Image-Based CLIP-Guided Essence Transfercited by 39
- 2021Normalized Avatar Synthesis Using StyleGAN and Perceptual Refinementcited by 36
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
- 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketchescited by 34
- 2021E2Style: Improve the Efficiency and Effectiveness of StyleGAN Inversioncited by 33
- 2021LOHO: Latent Optimization of Hairstyles via Orthogonalizationcited by 30
- 2022Face Generation and Editing with StyleGAN: A Surveycited by 27
- 2022Semantic uncertainty intervals for disentangled latent spacescited by 22
- 2022Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpointcited by 18
- 2022Editing Out-of-domain GAN Inversion via Differential Activationscited by 14
- 2023Comparing the Robustness of Modern No-Reference Image- and Video-Quality Metrics to Adversarial Attackscited by 14
- 2022StyleDomain: Efficient and Lightweight Parameterizations of StyleGAN for One-shot and Few-shot Domain Adaptationcited by 10
- 2021ISF-GAN: An Implicit Style Function for High-Resolution Image-to-Image Translationcited by 9
- 2021Unsupervised Novel View Synthesis from a Single Imagecited by 8
- 2021InvGAN: Invertible GANscited by 7
- 2022End-to-End Visual Editing with a Generatively Pre-Trained Artistcited by 7
- 2022Cycle Encoding of a StyleGAN Encoder for Improved Reconstruction and Editabilitycited by 7
- 2022Deep Generative Views to Mitigate Gender Classification Bias Across Gender-Race Groupscited by 7
- 2023What Decreases Editing Capability? Domain-Specific Hybrid Refinement for Improved GAN Inversioncited by 7
- 2021Transforming the Latent Space of StyleGAN for Real Face Editingcited by 6
- 2023Stable Attribute Group Editing for Reliable Few-shot Image Generationcited by 6
- 2023DisCO: Portrait Distortion Correction with Perspective-Aware 3D GANscited by 6
- 2021LatentKeypointGAN: Controlling Images via Latent Keypointscited by 5
- 20223D-Aware Encoding for Style-based Neural Radiance Fieldscited by 5
- 2022Expressive Talking Head Video Encoding in StyleGAN2 Latent-Spacecited by 4
- 2022Overparameterization Improves StyleGAN Inversioncited by 4
- 2022Semantic Unfolding of StyleGAN Latent Spacecited by 4
- 2022LSAP: Rethinking Inversion Fidelity, Perception and Editability in GAN Latent Spacecited by 4
- 2021Heredity-aware Child Face Image Generation with Latent Space Disentanglementcited by 3
- 2022A comprehensive survey on semantic facial attribute editing using generative adversarial networkscited by 3
- 2023A Self Supervised StyleGAN for Image Annotation and Classification with Extremely Limited Labelscited by 3
- 2024Blind Image Deconvolution by Generative-based Kernel Prior and Initializer via Latent Encodingcited by 3
50 most cited of 65 All 65 (JSON)
- 2025Generative Latent Kernel Modeling for Blind Motion Deblurring12 Jul 2025
- 2024FedHide: Federated Learning by Hiding in the Neighbors12 Sep 2024
- 2024Blind Image Deconvolution by Generative-based Kernel Prior and Initializer via Latent Encoding20 Jul 2024
- 2024SwinStyleformer is a favorable choice for image inversion19 Jun 2024
- 2023A Self Supervised StyleGAN for Image Annotation and Classification with Extremely Limited Labels26 Dec 2023
- 2023High-Quality Face Caricature via Style Translation22 Nov 2023
- 2023Comparing the Robustness of Modern No-Reference Image- and Video-Quality Metrics to Adversarial Attacks10 Oct 2023
- 2023Robust GAN inversion31 Aug 2023
- 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervision20 Jun 2023
- 2023TriPlaneNet: An Encoder for EG3D Inversion23 Mar 2023
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?21 Mar 2023
- 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketches20 Mar 2023
38 more
- 2023DisCO: Portrait Distortion Correction with Perspective-Aware 3D GANs23 Feb 2023
- 2023Gradient Adjusting Networks for Domain Inversion22 Feb 2023
- 2023Stable Attribute Group Editing for Reliable Few-shot Image Generation1 Feb 2023
- 2023What Decreases Editing Capability? Domain-Specific Hybrid Refinement for Improved GAN Inversion28 Jan 2023
- 2022StyleDomain: Efficient and Lightweight Parameterizations of StyleGAN for One-shot and Few-shot Domain Adaptation20 Dec 2022
- 2022Face Generation and Editing with StyleGAN: A Survey18 Dec 2022
- 2022QC-StyleGAN -- Quality Controllable Image Generation and Manipulation2 Dec 2022
- 2022Delving StyleGAN Inversion for Image Editing: A Foundation Latent Space Viewpoint21 Nov 2022
- 2022Assessing Neural Network Robustness via Adversarial Pivotal Tuning17 Nov 2022
- 2022Unsupervised Anomaly Appraisal of Cleft Faces Using a StyleGAN2-based Model Adaptation Technique12 Nov 2022
- 20223D-Aware Encoding for Style-based Neural Radiance Fields12 Nov 2022
- 20223D GAN Inversion with Pose Optimization13 Oct 2022
- 2022LSAP: Rethinking Inversion Fidelity, Perception and Editability in GAN Latent Space26 Sep 2022
- 2022Deep Generative Views to Mitigate Gender Classification Bias Across Gender-Race Groups17 Aug 2022
- 2022A Survey on Leveraging Pre-trained Generative Adversarial Networks for Image Editing and Restoration21 Jul 2022
- 2022Semantic uncertainty intervals for disentangled latent spaces20 Jul 2022
- 2022Cycle Encoding of a StyleGAN Encoder for Improved Reconstruction and Editability19 Jul 2022
- 2022Editing Out-of-domain GAN Inversion via Differential Activations17 Jul 2022
- 2022Semantic Unfolding of StyleGAN Latent Space29 Jun 2022
- 2022A comprehensive survey on semantic facial attribute editing using generative adversarial networks21 May 2022
- 2022Overparameterization Improves StyleGAN Inversion12 May 2022
- 2022LatentKeypointGAN: Controlling Images via Latent Keypoints -- Extended Abstract6 May 2022
- 2022End-to-End Visual Editing with a Generatively Pre-Trained Artist3 May 2022
- 2022Expanding the Latent Space of StyleGAN for Real Face Editing26 Apr 2022
- 2022Expressive Talking Head Video Encoding in StyleGAN2 Latent-Space28 Mar 2022
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGAN28 Feb 2022
- 2022Third Time's the Charm? Image and Video Editing with StyleGAN331 Jan 2022
- 2022Stitch it in Time: GAN-Based Facial Editing of Real Videos20 Jan 2022
- 2021InvGAN: Invertible GANs8 Dec 2021
- 2021HyperInverter: Improving StyleGAN Inversion via Hypernetwork1 Dec 2021
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editing30 Nov 2021
- 2021StylePart: Image-based Shape Part Manipulation20 Nov 2021
- 2021Image-Based CLIP-Guided Essence Transfer24 Oct 2021
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Models21 Oct 2021
- 2021ISF-GAN: An Implicit Style Function for High-Resolution Image-to-Image Translation26 Sep 2021
- 2021High-Fidelity GAN Inversion for Image Attribute Editing14 Sep 2021
- 2021Towards disease-aware image editing of chest X-rays2 Sep 2021
- 2021Heredity-aware Child Face Image Generation with Latent Space Disentanglement25 Aug 2021
50 newest of 65 All 65 (JSON)
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 542
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2021GAN Inversion: A Surveycited by 366
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2021Paint by Wordcited by 107
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2021HyperInverter: Improving StyleGAN Inversion via Hypernetworkcited by 85
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?cited by 84
- 2022Stitch it in Time: GAN-Based Facial Editing of Real Videoscited by 68
- 2021Using latent space regression to analyze and leverage compositionality in GANscited by 55
12 most cited of 64 All 64 (JSON)
- 2025Generative Latent Kernel Modeling for Blind Motion Deblurring12 Jul 2025
- 2024FedHide: Federated Learning by Hiding in the Neighbors12 Sep 2024
- 2024Blind Image Deconvolution by Generative-based Kernel Prior and Initializer via Latent Encoding20 Jul 2024
- 2024SwinStyleformer is a favorable choice for image inversion19 Jun 2024
- 2023A Self Supervised StyleGAN for Image Annotation and Classification with Extremely Limited Labels26 Dec 2023
- 2023High-Quality Face Caricature via Style Translation22 Nov 2023
- 2023Comparing the Robustness of Modern No-Reference Image- and Video-Quality Metrics to Adversarial Attacks10 Oct 2023
- 2023Robust GAN inversion31 Aug 2023
- 2023TriPlaneNet: An Encoder for EG3D Inversion23 Mar 2023
- 2023A Complete Survey on Generative AI (AIGC): Is ChatGPT from GPT-4 to GPT-5 All You Need?21 Mar 2023
- 2023Picture that Sketch: Photorealistic Image Generation from Abstract Sketches20 Mar 2023
- 2023DisCO: Portrait Distortion Correction with Perspective-Aware 3D GANs23 Feb 2023
12 newest of 64 All 64 (JSON)