High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANs
Not on the map. Why?
Cited by 124 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We present a new method for synthesizing high-resolution photo-realistic images from semantic label maps using conditional generative adversarial networks (conditional GANs). Conditional GANs have enabled a variety of applications, but the results are often limited to low-resolution and still far from realistic. In this work, we generate 2048x1024 visually appealing results with a novel adversarial loss, as well as new multi-scale generator and discriminator architectures. Furthermore, we extend our framework to interactive visual manipulation with two additional features. First, we incorporate object instance segmentation information, which enables object manipulations such as removing/adding objects and changing the object category. Second, we propose a method to generate diverse results given the same input, allowing users to edit the object appearance interactively. Human opinion studies demonstrate that our method significantly outperforms existing methods, advancing both the quality and the resolution of deep image synthesis and editing.
Key facts. Cited by 1,179 papers in the map (data through 14 Oct 2026). First posted on arXiv 30 Nov 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 336; 2022: 262; 2023: 245; 2024: 169; 2025: 111; 2026: 56.
1,179 papers.
Sort:
By area:
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2022Generative Adversarial Networkscited by 5,627
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 635
38 more
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 590
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
- 2021GAN Inversion: A Surveycited by 367
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
- 2021Motion Representations for Articulated Animationcited by 255
- 2022Transformers in Medical Imaging: A Surveycited by 245
- 2022Long Video Generation with Time-Agnostic VQGAN and Time-Sensitive Transformercited by 244
- 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
- 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
- 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 214
- 2021Neural Head Avatars from Monocular RGB Videoscited by 213
- 2021Projected GANs Converge Fastercited by 208
- 2023Controlling Text-to-Image Diffusion by Orthogonal Finetuningcited by 208
- 2022Diffusion-GAN: Training GANs with Diffusioncited by 205
- 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
- 2021How Faithful is your Synthetic Data? Sample-level Metrics for Evaluating and Auditing Generative Modelscited by 196
- 2023Dreamix: Video Diffusion Models are General Video Editorscited by 191
- 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 183
- 2021Audio-Driven Emotional Video Portraitscited by 180
- 2022Sketch-Guided Text-to-Image Diffusion Modelscited by 180
- 2022Depth-Aware Generative Adversarial Network for Talking Head Video Generationcited by 178
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2021ARCH++: Animation-Ready Clothed Human Reconstruction Revisitedcited by 174
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2021A Good Image Generator Is What You Need for High-Resolution Video Synthesiscited by 163
- 2023Dense Text-to-Image Generation with Attention Modulationcited by 163
- 2022Dress Code: High-Resolution Multi-Category Virtual Try-Oncited by 162
- 2022Pretraining is All You Need for Image-to-Image Translationcited by 160
- 2023Flow Matching in Latent Spacecited by 160
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
50 most cited of 1,179 All 1,179 (JSON)
- 2026DeBoneDiT: Depth-Driven Conditional Bridge Diffusion Transformers for Bone Suppression in Chest X-Ray Images14 Oct 2026
- 2026Shadow Feature Refinement Network: Progressive Feature Refinement based on Knowledge Distillation for Effective Shadow Removal4 Oct 2026
- 2026MRI Super-Resolution with RCDM/WaveMix and Task-Aware Segmentation30 Sep 2026
- 2026DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients29 Sep 2026
- 2026GeoSET: Generalist Foundation Model for SAR-to-EO Image Translation26 Sep 2026
- 2026GeoCR: Learning a Generalist Cloud Removal Prior from Heterogeneous Observations26 Sep 2026
- 2026Anatomy-Aware Synthesis of Post-Contrast Breast MRI from Pre-Contrast Images22 Sep 2026
- 2026Lesion-Gated Hybrid Synthesis for Virtual Contrast-Enhanced Breast MRI: A MAMA-SYNTH Challenge Solution18 Sep 2026
- 2026An End-to-End Automated Pipeline for Controllable Crack Data Synthesis11 Sep 2026
- 2026RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains2 Sep 2026
- 2026Semi-Supervised Virtual Staining via Morphology Preservation and Histopathological Realism Constraints1 Sep 2026
- 2026ReFlowSET: Representation-Aligned Latent Flow Matching for SAR-to-EO Image Translation1 Sep 2026
38 more
- 2026InteractGesture: Progressive Chunk Guidance for Continuous Streaming Co-Speech Gesture Control26 Aug 2026
- 2026RRFC: Recursive Refinement via Feedback Conditioning for Iterative Image-to-Image Generation16 Aug 2026
- 2026Where the Cost Falls: A Deployment-Aware Adoption Order for Stability Enhancements to Cycle-Consistent Adversarial Networks14 Aug 2026
- 2026Source-Agnostic Image Translation Based on Latent Aware Adaptive Masking14 Aug 2026
- 2026Overcoming Data Scarcity and Confidentiality in Hardware Assurance via Synthetic Generation10 Aug 2026
- 2026InstancePin: Instance-Addressable Layout-to-Image Diffusion via Coordinate Pinning1 Aug 2026
- 2026TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitive30 Jun 2026
- 2026UNITY: Attention Flow Networks for Adaptive Conditioning in Diffusion18 Jun 2026
- 2026Addressing Detail Bottlenecks in Latent Diffusion for RGB-to-SWIR Image Translation18 Jun 2026
- 2026Reviewing Model Collapse and Countermeasures17 Jun 2026
- 2026SketchXplain: Intuitive Visual Explanations of Image Classifiers with Sketches16 Jun 2026
- 2026Diagnosing Shape-Prior Shortcuts in Long-Range Single-Shot Fringe Projection Profilometry13 Jun 2026
- 2026Pix2Pix-Hybrid: Structure-Guided Conditional Synthesis of Hajj Crowd Images with Multi-Channel Conditioning and Weak Attribute Supervision12 Jun 2026
- 2026What neurosurgeons need to see: synthetic intra-operative MRI from ultrasound for brain-shift compensation in brain tumour surgery3 Jun 2026
- 2026A Systematic Benchmark of Intraoperative Ultrasound-to-MR Synthesis for Brain Tumour Surgery30 May 2026
- 2026VDSB-GWSyn: Diffusion Schr"odinger Bridge for Controllable and Anatomically Feasible Guidewire Synthesis in Coronary Angiography27 May 2026
- 2026Music Transcription with (Almost) No Supervision22 May 2026
- 2026MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modeling19 May 2026
- 2026Position: AI/ML Deepfake Research is Misaligned with AI-Generated Non-Consensual Intimate Imagery (AIG-NCII)16 May 2026
- 2026UniTriGen: Unified Triplet Generation of Aligned Visible-Infrared-Label for Few-Shot RGB-T Semantic Segmentation14 May 2026
- 2026AnyBand-Diff: A Unified Remote Sensing Image Generation and Band Repair Framework with Spectral Priors14 May 2026
- 2026Geometrically Constrained Stenosis Editing in Coronary Angiography via Entropic Optimal Transport9 May 2026
- 2026Anatomy of a failure: When, how, and why deep vision fails in scientific domains5 May 2026
- 2026LiveGesture Streamable Co-Speech Gesture Generation Model13 Apr 2026
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation7 Apr 2026
- 2026DRIFT: Deep Restoration, ISP Fusion, and Tone-mapping3 Apr 2026
- 2026Gated Condition Injection without Multimodal Attention: Towards Controllable Linear-Attention Transformers29 Mar 2026
- 2026VideoWeaver: Multimodal Multi-View Video-to-Video Transfer for Embodied Agents26 Mar 2026
- 2026HyPER-GAN: Hybrid Patch-Based Image-to-Image Translation for Real-Time Photorealism Enhancement in Game Engines11 Mar 2026
- 2026Component-Aware Sketch-to-Image Generation Using Self-Attention Encoding and Coordinate-Preserving Fusion10 Mar 2026
- 2026Improving Generative Adversarial Network Generalization for Facial Expression Synthesis4 Mar 2026
- 2026Motion Manipulation via Unsupervised Keypoint Positioning in Face Animation4 Mar 2026
- 2026Any2Any: Unified Arbitrary Modality Translation for Remote Sensing4 Mar 2026
- 2026Station2Radar: query conditioned gaussian splatting for precipitation field28 Feb 2026
- 2026A Proper Scoring Rule for Virtual Staining26 Feb 2026
- 2026RelA-Diffusion: Relativistic Adversarial Diffusion for Multi-Tracer PET Synthesis from Multi-Sequence MRI24 Feb 2026
- 2026Physics Encoded Spatial and Temporal Generative Adversarial Network for Tropical Cyclone Image Super-resolution19 Feb 2026
- 2026Efficient Text-Guided Convolutional Adapter for the Diffusion Model16 Feb 2026
50 newest of 1,179 All 1,179 (JSON)
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,351
- 2022Multi-Concept Customization of Text-to-Image Diffusioncited by 1,106
- 2023One-step Diffusion with Distribution Matching Distillationcited by 1,019
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 635
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
- 2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 214
12 most cited of 121 All 121 (JSON)
- 2026DeBoneDiT: Depth-Driven Conditional Bridge Diffusion Transformers for Bone Suppression in Chest X-Ray Images14 Oct 2026
- 2026RGB-to-IR image translation for infrared vehicle detection in unseen UAV domains2 Sep 2026
- 2026ReFlowSET: Representation-Aligned Latent Flow Matching for SAR-to-EO Image Translation1 Sep 2026
- 2026Source-Agnostic Image Translation Based on Latent Aware Adaptive Masking14 Aug 2026
- 2026InstancePin: Instance-Addressable Layout-to-Image Diffusion via Coordinate Pinning1 Aug 2026
- 2026UNITY: Attention Flow Networks for Adaptive Conditioning in Diffusion18 Jun 2026
- 2026Addressing Detail Bottlenecks in Latent Diffusion for RGB-to-SWIR Image Translation18 Jun 2026
- 2026AnyBand-Diff: A Unified Remote Sensing Image Generation and Band Repair Framework with Spectral Priors14 May 2026
- 2026HumANDiff: Articulated Noise Diffusion for Motion-Consistent Human Video Generation7 Apr 2026
- 2026Efficient Text-Guided Convolutional Adapter for the Diffusion Model16 Feb 2026
- 2026Cortex-Grounded Diffusion Models for Brain Image Generation27 Jan 2026
- 2026DSA-Tokenizer: Disentangled Semantic-Acoustic Tokenization via Flow Matching-based Hierarchical Fusion14 Jan 2026
12 newest of 121 All 121 (JSON)
- 2021CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakescited by 56
- 2021Deep Model Intellectual Property Protection via Deep Watermarkingcited by 54
- 2021Property Inference Attacks Against GANscited by 33
- 2021Membership Inference Attacks are Easier on Difficult Problemscited by 17
- 2021Exploring Structure Consistency for Deep Model Watermarkingcited by 1
- 2022Membership Privacy Protection for Image Translation Models via Adversarial Knowledge Distillationcited by 0
- 2022Membership Privacy Protection for Image Translation Models via Adversarial Knowledge Distillation10 Mar 2022
- 2021Property Inference Attacks Against GANs15 Nov 2021
- 2021Exploring Structure Consistency for Deep Model Watermarking5 Aug 2021
- 2021CMUA-Watermark: A Cross-Model Universal Adversarial Watermark for Combating Deepfakes23 May 2021
- 2021Deep Model Intellectual Property Protection via Deep Watermarking8 Mar 2021
- 2021Membership Inference Attacks are Easier on Difficult Problems15 Feb 2021
- 2022Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translationcited by 39
- 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translationcited by 10
- 2021Dual Discriminator Adversarial Distillation for Data-free Model Compressioncited by 9
- 2025Knowledge Distillation for Underwater Feature Extraction and Matching via GAN-synthesized Imagescited by 2
- 2026Shadow Feature Refinement Network: Progressive Feature Refinement based on Knowledge Distillation for Effective Shadow Removalcited by 0
- 2026Shadow Feature Refinement Network: Progressive Feature Refinement based on Knowledge Distillation for Effective Shadow Removal4 Oct 2026
- 2025Knowledge Distillation for Underwater Feature Extraction and Matching via GAN-synthesized Images11 Apr 2025
- 2022Region-aware Knowledge Distillation for Efficient Image-to-Image Translation25 May 2022
- 2022Wavelet Knowledge Distillation: Towards Efficient Image-to-Image Translation12 Mar 2022
- 2021Dual Discriminator Adversarial Distillation for Data-free Model Compression12 Apr 2021
- 2023NeuRAD: Neural Rendering for Autonomous Drivingcited by 150
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunitiescited by 24
- 2024Are NeRFs ready for autonomous driving? Towards closing the real-to-simulation gapcited by 20
- 2025Segmenting Objectiveness and Task-awareness Unknown Region for Autonomous Drivingcited by 5
- 2025Segmenting Objectiveness and Task-awareness Unknown Region for Autonomous Driving27 Apr 2025
- 2024Are NeRFs ready for autonomous driving? Towards closing the real-to-simulation gap24 Mar 2024
- 2024Forging Vision Foundation Models for Autonomous Driving: Challenges, Methodologies, and Opportunities16 Jan 2024
- 2023NeuRAD: Neural Rendering for Autonomous Driving26 Nov 2023
- 2026Reviewing Model Collapse and Countermeasurescited by 0
- 2026Reviewing Model Collapse and Countermeasures17 Jun 2026
- 2022Generative Adversarial Networkscited by 5,627
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2021Alias-Free Generative Adversarial Networkscited by 1,184
- 2021Resolution-robust Large Mask Inpainting with Fourier Convolutionscited by 738
- 2023Zero-shot Image-to-Image Translationcited by 505
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
- 2021GAN Inversion: A Surveycited by 367
- 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 349
- 2023Video-P2P: Video Editing with Cross-attention Controlcited by 314
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
- 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
12 most cited of 1,032 All 1,032 (JSON)
- 2026MRI Super-Resolution with RCDM/WaveMix and Task-Aware Segmentation30 Sep 2026
- 2026DRHeC: Differentiable Rendering for Hand-Eye Calibration with RGB-Based Gradients29 Sep 2026
- 2026GeoSET: Generalist Foundation Model for SAR-to-EO Image Translation26 Sep 2026
- 2026GeoCR: Learning a Generalist Cloud Removal Prior from Heterogeneous Observations26 Sep 2026
- 2026Anatomy-Aware Synthesis of Post-Contrast Breast MRI from Pre-Contrast Images22 Sep 2026
- 2026Lesion-Gated Hybrid Synthesis for Virtual Contrast-Enhanced Breast MRI: A MAMA-SYNTH Challenge Solution18 Sep 2026
- 2026An End-to-End Automated Pipeline for Controllable Crack Data Synthesis11 Sep 2026
- 2026Semi-Supervised Virtual Staining via Morphology Preservation and Histopathological Realism Constraints1 Sep 2026
- 2026InteractGesture: Progressive Chunk Guidance for Continuous Streaming Co-Speech Gesture Control26 Aug 2026
- 2026RRFC: Recursive Refinement via Feedback Conditioning for Iterative Image-to-Image Generation16 Aug 2026
- 2026Where the Cost Falls: A Deployment-Aware Adoption Order for Stability Enhancements to Cycle-Consistent Adversarial Networks14 Aug 2026
- 2026Overcoming Data Scarcity and Confidentiality in Hardware Assurance via Synthetic Generation10 Aug 2026
12 newest of 1,032 All 1,032 (JSON)