Neural Photo Editing with Introspective Adversarial Networks
Not on the map. Why?
Abstract (arXiv)
The increasingly photorealistic sample quality of generative image models suggests their feasibility in applications beyond image generation. We present the Neural Photo Editor, an interface that leverages the power of generative neural networks to make large, semantically coherent changes to existing images. To tackle the challenge of achieving accurate reconstructions without loss of feature quality, we introduce the Introspective Adversarial Network, a novel hybridization of the VAE and GAN. Our model efficiently captures long-range dependencies through use of a computational block based on weight-shared dilated convolutions, and improves generalization performance with Orthogonal Regularization, a novel weight regularization method. We validate our contributions on CelebA, SVHN, and CIFAR-100, and produce samples and reconstructions with high visual fidelity.
Key facts. Cited by 109 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Sep 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 38; 2022: 17; 2023: 26; 2024: 17; 2025: 9; 2026: 2.
109 papers.
Sort:
By area:
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2022Generative Adversarial Networkscited by 5,603
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 264
- 2021Editing Conditional Radiance Fieldscited by 222
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
- 2023Generalizing Dataset Distillation via Deep Generative Priorcited by 125
- 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
- 2021D2C: Diffusion-Denoising Models for Few-shot Conditional Generationcited by 96
38 more
- 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
- 2023Stay on topic with Classifier-Free Guidancecited by 90
- 2022Synthetic Data -- what, why and how?cited by 66
- 2021GAN-Supervised Dense Visual Alignmentcited by 61
- 2023LayoutDM: Transformer-based Diffusion Model for Layout Generationcited by 57
- 2021In&Out : Diverse Image Outpainting via GAN Inversioncited by 55
- 2021Anycost GANs for Interactive Image Synthesis and Editingcited by 54
- 2021Ensembling with Deep Generative Viewscited by 53
- 2022UniTune: Text-Driven Image Editing by Fine Tuning a Diffusion Model on a Single Imagecited by 42
- 2022Spatially-Adaptive Multilayer Selection for GAN Inversion and Editingcited by 39
- 2022StudioGAN: A Taxonomy and Benchmark of GANs for Image Synthesiscited by 38
- 2021Learning with Hyperspherical Uniformitycited by 35
- 2021Orthogonal Jacobian Regularization for Unsupervised Disentanglement in Image Generationcited by 35
- 2024Copyright Protection in Generative AI: A Technical Perspectivecited by 35
- 2023HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networkscited by 32
- 2024Conditional Image Synthesis with Diffusion Models: A Surveycited by 29
- 2021Conditional Generative Models for Counterfactual Explanationscited by 28
- 2021Verification of Image-based Neural Network Controllers Using Generative Modelscited by 27
- 2021Unsupervised Foreground Extraction via Deep Region Competitioncited by 26
- 2023CUDA: Convolution-based Unlearnable Datasetscited by 26
- 2021Linear Semantics in Generative Adversarial Networkscited by 25
- 2021Gradient Normalization for Generative Adversarial Networkscited by 25
- 2024Revisiting Non-Autoregressive Transformers for Efficient Image Synthesiscited by 22
- 2024ODICE: Revealing the Mystery of Distribution Correction Estimation via Orthogonal-gradient Updatecited by 21
- 2024Unlocking Dataset Distillation with Diffusion Modelscited by 21
- 2021Towards Deeper Deep Reinforcement Learning with Spectral Normalizationcited by 19
- 2022Avocodo: Generative Adversarial Network for Artifact-free Vocodercited by 18
- 2022Tele-Knowledge Pre-training for Fault Analysiscited by 18
- 2021Toward Spatially Unbiased Generative Modelscited by 17
- 2021Wasserstein Generative Adversarial Uncertainty Quantification in Physics-Informed Neural Networkscited by 16
- 2023Adversarial Score Distillation: When score distillation meets GANcited by 15
- 2024Learn to Preserve and Diversify: Parameter-Efficient Group with Orthogonal Regularization for Domain Generalizationcited by 14
- 2024Hierarchical Features Matter: A Deep Exploration of Progressive Parameterization Method for Dataset Distillationcited by 13
- 2021ExSinGAN: Learning an Explainable Generative Model from a Single Imagecited by 12
- 2024Text-centric Alignment for Multi-Modality Learningcited by 12
- 2021Comparison and Analysis of Image-to-Image Generative Adversarial Networks: A Surveycited by 11
- 2021Learning cortical representations through perturbed and adversarial dreamingcited by 10
- 2021StyleCariGAN: Caricature Generation via StyleGAN Feature Map Modulationcited by 9
50 most cited of 109 All 109 (JSON)
- 2026Dispelling the Curse of Singularities in Neural Network Optimizations1 Feb 2026
- 2026Training Free Zero-Shot Visual Anomaly Localization via Diffusion Inversion12 Jan 2026
- 2025ADHAM: Additive Deep Hazard Analysis Mixtures for Interpretable Survival Regression8 Sep 2025
- 2025Tell-Tale Watermarks for Explanatory Reasoning in Synthetic Media Forensics6 Sep 2025
- 2025Distance-informed Neural Processes26 Aug 2025
- 2025Weights-Rotated Preference Optimization for Large Language Models25 Aug 2025
- 2025Aliasing in Convnets: A Frame-Theoretic Perspective8 Jul 2025
- 2025Generative Adversarial Networks with Limited Data: A Survey and Benchmarking7 Apr 2025
- 2025Learning Vision-Based Neural Network Controllers with Semi-Probabilistic Safety Guarantees28 Feb 2025
- 2025Steganography Beyond Space-Time with Chain of Multimodal AI25 Feb 2025
- 2025End-to-end Training for Text-to-Image Synthesis using Dual-Text Embeddings3 Feb 2025
- 2024Conditional Image Synthesis with Diffusion Models: A Survey28 Sep 2024
38 more
- 2024Physics-aligned Schr"odinger bridge26 Sep 2024
- 2024Learn to Preserve and Diversify: Parameter-Efficient Group with Orthogonal Regularization for Domain Generalization21 Jul 2024
- 2024Enhancing Robustness of Vision-Language Models through Orthogonality Learning and Self-Regularization11 Jul 2024
- 2024Enhancing Multi-Class Anomaly Detection via Diffusion Refinement with Dual Conditioning2 Jul 2024
- 2024LatentExplainer: Explaining Latent Representations in Deep Generative Models with Multimodal Large Language Models21 Jun 2024
- 2024Hierarchical Features Matter: A Deep Exploration of Progressive Parameterization Method for Dataset Distillation9 Jun 2024
- 2024Revisiting Non-Autoregressive Transformers for Efficient Image Synthesis8 Jun 2024
- 2024"Noisier" Noise Contrastive Eestimation is (Almost) Maximum Likelihood27 May 2024
- 2024Diffusion based Zero-shot Medical Image-to-Image Translation for Cross Modality Segmentation1 Apr 2024
- 2024Unlocking Dataset Distillation with Diffusion Models6 Mar 2024
- 2024Pyramid Attention Network for Medical Image Registration14 Feb 2024
- 2024Multi-modality transrectal ultrasound video classification for identification of clinically significant prostate cancer14 Feb 2024
- 2024Text-centric Alignment for Multi-Modality Learning12 Feb 2024
- 2024SpirDet: Towards Efficient, Accurate and Lightweight Infrared Small Target Detector8 Feb 2024
- 2024Copyright Protection in Generative AI: A Technical Perspective4 Feb 2024
- 2024ODICE: Revealing the Mystery of Distribution Correction Estimation via Orthogonal-gradient Update1 Feb 2024
- 2023Promoting Segment Anything Model towards Highly Accurate Dichotomous Image Segmentation30 Dec 2023
- 2023Adversarial Score Distillation: When score distillation meets GAN1 Dec 2023
- 2023HetGPT: Harnessing the Power of Prompt Tuning in Pre-Trained Heterogeneous Graph Neural Networks23 Oct 2023
- 2023Leveraging Hierarchical Feature Sharing for Efficient Dataset Condensation11 Oct 2023
- 2023Multi-scale MRI reconstruction via dilated ensemble networks7 Oct 2023
- 2023Preserving Specificity in Federated Graph Learning for fMRI-based Neurological Disorder Identification20 Aug 2023
- 2023Learning beyond sensations: how dreams organize neuronal representations3 Aug 2023
- 2023Interactive Neural Painting31 Jul 2023
- 2023Image Captions are Natural Prompts for Text-to-Image Models17 Jul 2023
- 2023Stay on topic with Classifier-Free Guidance30 Jun 2023
- 2023Penalty Gradient Normalization for Generative Adversarial Networks23 Jun 2023
- 2023Towards Better Orthogonality Regularization with Disentangled Norm in Training Deep CNNs16 Jun 2023
- 2023PQA: Exploring the Potential of Product Quantization in DNN Hardware Acceleration25 May 2023
- 2023JoIN: Joint GANs Inversion for Intrinsic Image Decomposition18 May 2023
- 2023LayoutDM: Transformer-based Diffusion Model for Layout Generation4 May 2023
- 2023Generalizing Dataset Distillation via Deep Generative Prior2 May 2023
- 2023Make It So: Steering StyleGAN for Any Image Inversion and Editing27 Apr 2023
- 2023ImageEye: Batch Image Processing Using Program Synthesis6 Apr 2023
- 2023A Diffusion-based Method for Multi-turn Compositional Image Generation5 Apr 2023
- 2023Text-to-image Diffusion Models in Generative AI: A Survey14 Mar 2023
- 2023Scaling up GANs for Text-to-Image Synthesis9 Mar 2023
- 2023Rethinking the editing of generative adversarial networks: a method to estimate editing vectors based on dimension reduction7 Mar 2023
50 newest of 109 All 109 (JSON)
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
- 2023Text-to-image Diffusion Models in Generative AI: A Surveycited by 264
- 2023LayoutDM: Transformer-based Diffusion Model for Layout Generationcited by 57
- 2022UniTune: Text-Driven Image Editing by Fine Tuning a Diffusion Model on a Single Imagecited by 42
- 2024Conditional Image Synthesis with Diffusion Models: A Surveycited by 29
- 2024Revisiting Non-Autoregressive Transformers for Efficient Image Synthesiscited by 22
- 2024Unlocking Dataset Distillation with Diffusion Modelscited by 21
- 2023Spatial-temporal Transformer-guided Diffusion based Data Augmentation for Efficient Skeleton-based Action Recognitioncited by 4
- 2023A Diffusion-based Method for Multi-turn Compositional Image Generationcited by 4
- 2026Training Free Zero-Shot Visual Anomaly Localization via Diffusion Inversioncited by 1
- 2026Training Free Zero-Shot Visual Anomaly Localization via Diffusion Inversion12 Jan 2026
- 2024Conditional Image Synthesis with Diffusion Models: A Survey28 Sep 2024
- 2024Revisiting Non-Autoregressive Transformers for Efficient Image Synthesis8 Jun 2024
- 2024Unlocking Dataset Distillation with Diffusion Models6 Mar 2024
- 2023LayoutDM: Transformer-based Diffusion Model for Layout Generation4 May 2023
- 2023A Diffusion-based Method for Multi-turn Compositional Image Generation5 Apr 2023
- 2023Text-to-image Diffusion Models in Generative AI: A Survey14 Mar 2023
- 2023Spatial-temporal Transformer-guided Diffusion based Data Augmentation for Efficient Skeleton-based Action Recognition26 Feb 2023
- 2022UniTune: Text-Driven Image Editing by Fine Tuning a Diffusion Model on a Single Image17 Oct 2022
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Models6 Aug 2021
- 2021Diffusion Models Beat GANs on Image Synthesis11 May 2021
- 2022Generative Adversarial Networkscited by 5,603
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2021Editing Conditional Radiance Fieldscited by 222
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2021Semantic Segmentation with Generative Models: Semi-Supervised Learning and Strong Out-of-Domain Generalizationcited by 141
- 2023Generalizing Dataset Distillation via Deep Generative Priorcited by 125
- 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
- 2021D2C: Diffusion-Denoising Models for Few-shot Conditional Generationcited by 96
- 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
- 2023Stay on topic with Classifier-Free Guidancecited by 90
- 2022Synthetic Data -- what, why and how?cited by 66
12 most cited of 93 All 93 (JSON)
- 2026Dispelling the Curse of Singularities in Neural Network Optimizations1 Feb 2026
- 2025ADHAM: Additive Deep Hazard Analysis Mixtures for Interpretable Survival Regression8 Sep 2025
- 2025Tell-Tale Watermarks for Explanatory Reasoning in Synthetic Media Forensics6 Sep 2025
- 2025Distance-informed Neural Processes26 Aug 2025
- 2025Aliasing in Convnets: A Frame-Theoretic Perspective8 Jul 2025
- 2025Generative Adversarial Networks with Limited Data: A Survey and Benchmarking7 Apr 2025
- 2025Learning Vision-Based Neural Network Controllers with Semi-Probabilistic Safety Guarantees28 Feb 2025
- 2025Steganography Beyond Space-Time with Chain of Multimodal AI25 Feb 2025
- 2025End-to-end Training for Text-to-Image Synthesis using Dual-Text Embeddings3 Feb 2025
- 2024Physics-aligned Schr"odinger bridge26 Sep 2024
- 2024Learn to Preserve and Diversify: Parameter-Efficient Group with Orthogonal Regularization for Domain Generalization21 Jul 2024
- 2024Enhancing Multi-Class Anomaly Detection via Diffusion Refinement with Dual Conditioning2 Jul 2024
12 newest of 93 All 93 (JSON)