Image2StyleGAN++: How to Edit the Embedded Images?
Not on the map. Why?
Cited by 54 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We propose Image2StyleGAN++, a flexible image editing framework with many applications. Our framework extends the recent Image2StyleGAN in three ways. First, we introduce noise optimization as a complement to the W^+ latent space embedding. Our noise optimization can restore high-frequency features in images and thus significantly improves the quality of reconstructed images, e.g. a big increase of PSNR from 20 dB to 45 dB. Second, we extend the global W^+ latent space embedding to enable local embeddings. Third, we combine embedding with activation tensor manipulation to perform high-quality local edits along with global semantic edits on images. Such edits motivate various high-quality image editing applications, e.g. image reconstruction, image inpainting, image crossover, local style transfer, image editing using scribbles, and attribute level feature transfer. Examples of the edited images are shown across the paper for visual inspection.
Key facts. Cited by 356 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 77; 2022: 119; 2023: 100; 2024: 40; 2025: 16; 2026: 4.
356 papers.
Sort:
By area:
- 2022Generative Adversarial Networkscited by 5,627
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 635
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
- 2023Zero-shot Image-to-Image Translationcited by 505
38 more
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 449
- 2022Blended Latent Diffusioncited by 432
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
- 2021GAN Inversion: A Surveycited by 367
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 265
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2023P+: Extended Textual Conditioning in Text-to-Image Generationcited by 242
- 2023Break-A-Scene: Extracting Multiple Concepts from a Single Imagecited by 231
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2021HyperStyle: StyleGAN Inversion with HyperNetworks for Real Image Editingcited by 208
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 195
- 2023TF-ICON: Diffusion-Based Training-Free Cross-Domain Image Compositioncited by 182
- 2022Latent Image Animator: Learning to Animate Images via Latent Space Navigationcited by 175
- 2022StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGANcited by 169
- 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 163
- 2022StyleGAN-Human: A Data-Centric Odyssey of Human Generationcited by 144
- 2024ReNoise: Real Image Inversion Through Iterative Noisingcited by 128
- 2023Generalizing Dataset Distillation via Deep Generative Priorcited by 126
- 2023A Neural Space-Time Representation for Text-to-Image Personalizationcited by 123
- 2022Uncovering the Disentanglement Capability in Text-to-Image Diffusion Modelscited by 116
- 2024Stable Flow: Vital Layers for Training-Free Image Editingcited by 113
- 2023Diffusion with Forward Models: Solving Stochastic Inverse Problems Without Direct Supervisioncited by 112
- 2021Paint by Wordcited by 107
- 2021Regularizing Generative Adversarial Networks under Limited Datacited by 107
- 2021One Shot Face Swapping on Megapixelscited by 105
- 2021Gradient Inversion with Generative Image Priorcited by 101
- 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
- 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
- 2023StyleSync: High-Fidelity Generalized and Personalized Lip Sync in Style-based Generatorcited by 89
- 2023Domain-Agnostic Tuning-Encoder for Fast Personalization of Text-To-Image Modelscited by 85
- 2023Effective Real Image Editing with Accelerated Iterative Diffusion Inversioncited by 79
- 2021Mind the Gap: Domain Gap Control for Single Shot Domain Adaptation for Generative Adversarial Networkscited by 68
50 most cited of 356 All 356 (JSON)
- 2026Geometry Preserving Loss Functions Promote Improved Adaptation of Blackbox Generative Model26 Apr 2026
- 2026Learning Spatial-Temporal Coherent Correlations for Speech-Preserving Facial Expression Manipulation22 Apr 2026
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2026Training Free Zero-Shot Visual Anomaly Localization via Diffusion Inversion12 Jan 2026
- 2025CARLoS: Retrieval via Concise Assessment Representation of LoRAs at Scale9 Dec 2025
- 2025WarpGAN: Warping-Guided 3D GAN Inversion with Style-Based Novel View Inpainting11 Nov 2025
- 2025GPTFace: Generative Pre-training of Facial-Linguistic Transformer by Span Masking and Weakly Correlated Text-image Data21 Oct 2025
- 2025AgeBooth: Controllable Facial Aging and Rejuvenation via Diffusion Models7 Oct 2025
- 2025Advancing Facial Stylization through Semantic Preservation Constraint and Pseudo-Paired Supervision27 Jun 2025
- 2025SceneCrafter: Controllable Multi-View Driving Scene Editing24 Jun 2025
- 2025MambaStyle: Efficient StyleGAN Inversion for Real Image Editing with State-Space Models6 May 2025
- 2025Hadamard product in deep learning: Introduction, Advances and Challenges17 Apr 2025
38 more
- 2025Pose and Facial Expression Transfer by using StyleGAN17 Apr 2025
- 2025High-Fidelity Image Inpainting with Multimodal Guided GAN Inversion17 Apr 2025
- 2025Contrastive Decoupled Representation Learning and Regularization for Speech-Preserving Facial Expression Manipulation8 Apr 2025
- 2025Generative Adversarial Networks with Limited Data: A Survey and Benchmarking7 Apr 2025
- 2025Latent Embedding Adaptation for Human Preference Alignment in Diffusion Planners24 Mar 2025
- 2025Personalized Image Generation with Deep Generative Models: A Decade Survey18 Feb 2025
- 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Space21 Jan 2025
- 2025IP-FaceDiff: Identity-Preserving Facial Video Editing with Diffusion13 Jan 2025
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing26 Dec 2024
- 2024Stable Flow: Vital Layers for Training-Free Image Editing21 Nov 2024
- 2024HyperGAN-CLIP: A Unified Framework for Domain Adaptation, Image Synthesis and Manipulation19 Nov 2024
- 2024Inversion-based Latent Bayesian Optimization8 Nov 2024
- 2024Order-aware Interactive Segmentation16 Oct 2024
- 2024RefineStyle: Dynamic Convolution Refinement for StyleGAN8 Oct 2024
- 2024Dual Encoder GAN Inversion for High-Fidelity 3D Head Reconstruction from Single Images30 Sep 2024
- 2024Conditional Image Synthesis with Diffusion Models: A Survey28 Sep 2024
- 2024Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editing23 Aug 2024
- 2024CODE: Confident Ordinary Differential Editing22 Aug 2024
- 2024Knowledge-Aided Semantic Communication Leveraging Probabilistic Graphical Modeling8 Aug 2024
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models1 Aug 2024
- 2024Learning Feature-Preserving Portrait Editing from Generated Pairs29 Jul 2024
- 2024Prediction Exposes Your Face: Black-box Model Inversion via Prediction Alignment11 Jul 2024
- 2024Synthetic to Authentic: Transferring Realism to 3D Face Renderings for Boosting Face Recognition10 Jul 2024
- 2024The Tug-of-War Between Deepfake Generation and Detection8 Jul 2024
- 2024SwinStyleformer is a favorable choice for image inversion19 Jun 2024
- 2024Diffusion Bridge AutoEncoders for Unsupervised Representation Learning27 May 2024
- 2024AdjointDEIS: Efficient Gradients for Diffusion Models23 May 2024
- 2024ReasonPix2Pix: Instruction Reasoning Dataset for Advanced Image Editing18 May 2024
- 2024Faces that Speak: Jointly Synthesising Talking Face and Speech from Text16 May 2024
- 2024Learning Feature Inversion for Multi-class Anomaly Detection under General-purpose COCO-AD Benchmark16 Apr 2024
- 2024Text-Driven Diverse Facial Texture Generation via Progressive Latent-Space Refinement15 Apr 2024
- 2024Responsible Visual Editing8 Apr 2024
- 2024Diffusion based Zero-shot Medical Image-to-Image Translation for Cross Modality Segmentation1 Apr 2024
- 2024Learning to Generate Conditional Tri-plane for 3D-aware Expression Controllable Portrait Animation31 Mar 2024
- 2024U-VAP: User-specified Visual Appearance Personalization via Decoupled Self Augmentation29 Mar 2024
- 2024Disentangling Racial Phenotypes: Fine-Grained Control of Race-related Facial Phenotype Characteristics29 Mar 2024
- 2024Deep Generative Model based Rate-Distortion for Image Downscaling Assessment22 Mar 2024
- 2024ReNoise: Real Image Inversion Through Iterative Noising21 Mar 2024
50 newest of 356 All 356 (JSON)
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022Null-text Inversion for Editing Real Images using Guided Diffusion Modelscited by 1,179
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 927
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 635
- 2021Diffusion Autoencoders: Toward a Meaningful and Decodable Representationcited by 449
- 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 265
- 2024Diffusion Model-Based Image Editing: A Surveycited by 212
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
- 2023DragonDiffusion: Enabling Drag-style Manipulation on Diffusion Modelscited by 195
12 most cited of 53 All 53 (JSON)
- 2026AHOY! Animatable Humans under Occlusion from YouTube Videos with Gaussian Splatting and Video Diffusion Priors18 Mar 2026
- 2026Training Free Zero-Shot Visual Anomaly Localization via Diffusion Inversion12 Jan 2026
- 2025AgeBooth: Controllable Facial Aging and Rejuvenation via Diffusion Models7 Oct 2025
- 2025TokenVerse: Versatile Multi-concept Personalization in Token Modulation Space21 Jan 2025
- 2024Stable Flow: Vital Layers for Training-Free Image Editing21 Nov 2024
- 2024Conditional Image Synthesis with Diffusion Models: A Survey28 Sep 2024
- 2024Task-Oriented Diffusion Inversion for High-Fidelity Text-based Editing23 Aug 2024
- 2024CODE: Confident Ordinary Differential Editing22 Aug 2024
- 2024TurboEdit: Text-Based Image Editing Using Few-Step Diffusion Models1 Aug 2024
- 2024AdjointDEIS: Efficient Gradients for Diffusion Models23 May 2024
- 2024ReNoise: Real Image Inversion Through Iterative Noising21 Mar 2024
- 2024Diffusion Model-Based Image Editing: A Survey27 Feb 2024
12 newest of 53 All 53 (JSON)
- 2022Blended Latent Diffusioncited by 432
- 2022Blended Latent Diffusion6 Jun 2022
- 2022Generative Adversarial Networkscited by 5,627
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2021Designing an Encoder for StyleGAN Image Manipulationcited by 544
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2021StyleNeRF: A Style-based 3D-Aware Generator for High-resolution Image Synthesiscited by 477
- 2021Pivotal Tuning for Latent-based Editing of Real Imagescited by 427
- 2023ELITE: Encoding Visual Concepts into Textual Embeddings for Customized Text-to-Image Generationcited by 416
- 2021CLIP-NeRF: Text-and-Image Driven Manipulation of Neural Radiance Fieldscited by 370
- 2021GAN Inversion: A Surveycited by 367
- 2021StyleSDF: High-Resolution 3D-Consistent Image and Geometry Generationcited by 289
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
12 most cited of 301 All 301 (JSON)
- 2026Geometry Preserving Loss Functions Promote Improved Adaptation of Blackbox Generative Model26 Apr 2026
- 2026Learning Spatial-Temporal Coherent Correlations for Speech-Preserving Facial Expression Manipulation22 Apr 2026
- 2025CARLoS: Retrieval via Concise Assessment Representation of LoRAs at Scale9 Dec 2025
- 2025WarpGAN: Warping-Guided 3D GAN Inversion with Style-Based Novel View Inpainting11 Nov 2025
- 2025GPTFace: Generative Pre-training of Facial-Linguistic Transformer by Span Masking and Weakly Correlated Text-image Data21 Oct 2025
- 2025Advancing Facial Stylization through Semantic Preservation Constraint and Pseudo-Paired Supervision27 Jun 2025
- 2025SceneCrafter: Controllable Multi-View Driving Scene Editing24 Jun 2025
- 2025MambaStyle: Efficient StyleGAN Inversion for Real Image Editing with State-Space Models6 May 2025
- 2025Hadamard product in deep learning: Introduction, Advances and Challenges17 Apr 2025
- 2025Pose and Facial Expression Transfer by using StyleGAN17 Apr 2025
- 2025High-Fidelity Image Inpainting with Multimodal Guided GAN Inversion17 Apr 2025
- 2025Contrastive Decoupled Representation Learning and Regularization for Speech-Preserving Facial Expression Manipulation8 Apr 2025
12 newest of 301 All 301 (JSON)