Diverse Image Synthesis from Semantic Layouts via Conditional IMLE
Not on the map. Why?
Abstract (arXiv)
Most existing methods for conditional image synthesis are only able to generate a single plausible image for any given input, or at best a fixed number of plausible images. In this paper, we focus on the problem of generating images from semantic segmentation maps and present a simple new method that can generate an arbitrary number of images with diverse appearance for the same semantic layout. Unlike most existing approaches which adopt the GAN framework, our method is based on the recently introduced Implicit Maximum Likelihood Estimation (IMLE) framework. Compared to the leading approach, our method is able to generate more diverse images while producing fewer artifacts despite using the same architecture. The learned latent space also has sensible structure despite the lack of supervision that encourages such behaviour. Videos and code are available at https://people.eecs.berkeley.edu/~ke.li/projects/imle/scene_layouts/.
Key facts. Cited by 60 papers in the map (data through 14 Oct 2026). First posted on arXiv 29 Nov 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 13; 2022: 8; 2023: 6; 2024: 13; 2025: 13; 2026: 7.
60 papers.
Sort:
By area:
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 168
- 2022Semantic Image Synthesis via Diffusion Modelscited by 132
- 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 89
- 2022Fusing Global and Local Features for Generalized AI-Synthesized Image Detectioncited by 88
- 2021A Closer Look at Fourier Spectrum Discrepancies for CNN-generated Images Detectioncited by 68
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2024Real-Time Deepfake Detection in the Real-Worldcited by 51
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
38 more
- 2023Generalizable Synthetic Image Detection via Language-guided Contrastive Learningcited by 49
- 2021Image Synthesis via Semantic Compositioncited by 45
- 2022A Continual Deepfake Detection Benchmark: Dataset, Methods, and Essentialscited by 45
- 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancycited by 45
- 2023GenDet: Towards Good Generalizations for AI-Generated Image Detectioncited by 36
- 2022BlobGAN: Spatially Disentangled Scene Representationscited by 35
- 2025MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillationcited by 31
- 2021Learning by Planning: Language-Guided Global Image Editingcited by 25
- 2023Level Up the Deepfake Detection: a Method to Effectively Discriminate Images Generated by GAN Architectures and Diffusion Modelscited by 21
- 2024Mixture of Low-rank Experts for Transferable AI-Generated Image Detectioncited by 21
- 2021Learning to Disentangle GAN Fingerprint for Fake Image Attributioncited by 20
- 2024SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flowcited by 20
- 2022Retrieval-based Spatially Adaptive Normalization for Semantic Image Synthesiscited by 15
- 2024ForgeLens: Data-Efficient Forgery Focus for Generalizable Forgery Image Detectioncited by 15
- 2023Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-artcited by 14
- 2025Methods and Trends in Detecting AI-Generated Images: A Comprehensive Reviewcited by 12
- 2021MCL-GAN: Generative Adversarial Networks with Multiple Specialized Discriminatorscited by 11
- 2025Stay-Positive: A Case for Ignoring Real Image Features in Fake Image Detectioncited by 11
- 2025Manifold Induced Biases for Zero-shot and Few-shot Detection of Generated Imagescited by 10
- 2025AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detectioncited by 10
- 2025Towards Generalizable AI-Generated Image Detection via Image-Adaptive Prompt Learningcited by 9
- 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Modelscited by 8
- 2021A-PixelHop: A Green, Robust and Explainable Fake-Image Detectorcited by 7
- 2024Automatic Controllable Colorization via Imaginationcited by 7
- 2026PGC: Peak-Guided Calibration for Generalizable AI-Generated Image Detectioncited by 6
- 2021Multimodal Shape Completion via IMLEcited by 5
- 2025AI-Generated Image Detection: An Empirical Study and Future Research Directionscited by 5
- 2021Few-shot Semantic Image Synthesis Using StyleGAN Priorcited by 4
- 2022Stay Positive: Non-Negative Image Synthesis for Augmented Realitycited by 4
- 2025SFLD: Reducing the content bias for AI-generated Image Detectioncited by 4
- 2024HyperDet: Generalizable Detection of Synthesized Images by Generating and Merging A Mixture of Hyper LoRAscited by 3
- 2023Inferring and Leveraging Parts from Object Shape for Improving Semantic Image Synthesiscited by 2
- 2025Leveraging Failed Samples: A Few-Shot and Training-Free Framework for Generalized Deepfake Detectioncited by 2
- 2025Semantic-Aware Reconstruction Error for Detecting AI-Generated Imagescited by 2
- 2026Do Transformations Reveal the Truth? Generative Residual Learning for Generalized AI-Generated Image Detectioncited by 2
- 2021Fake Visual Content Detection Using Two-Stream Convolutional Neural Networkscited by 1
- 2021[RE] CNN-generated images are surprisingly easy to spot...for nowcited by 1
- 2021Diversifying Semantic Image Synthesis and Editing via Class- and Layer-wise VAEscited by 1
50 most cited of 60 All 60 (JSON)
- 2026PE-Mamba: Bidirectional Selective Layer Aggregation for AI-Generated Image Detection8 Aug 2026
- 2026FakeI2V-Bench: Benchmarking the Applicability of Image-level Deepfake Detectors for Deepfake Video Detection4 Aug 2026
- 2026Do Transformations Reveal the Truth? Generative Residual Learning for Generalized AI-Generated Image Detection9 Jul 2026
- 2026PGC: Peak-Guided Calibration for Generalizable AI-Generated Image Detection20 May 2026
- 2026Can Visual Mamba Improve AI-Generated Image Detection? An In-Depth Investigation14 May 2026
- 2026When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detection10 Mar 2026
- 2026RealStats: A Rigorous Real-Only Statistical Framework for Fake Image Detection26 Jan 2026
- 2025AI-Generated Image Detection: An Empirical Study and Future Research Directions4 Nov 2025
- 2025Semantic-Aware Reconstruction Error for Detecting AI-Generated Images13 Aug 2025
- 2025Leveraging Failed Samples: A Few-Shot and Training-Free Framework for Generalized Deepfake Detection13 Aug 2025
- 2025Towards Generalizable AI-Generated Image Detection via Image-Adaptive Prompt Learning3 Aug 2025
- 2025MiraGe: Multimodal Discriminative Representation Learning for Generalizable AI-Generated Image Detection3 Aug 2025
38 more
- 2025Unraveling Hidden Representations: A Multi-Modal Layer Analysis for Better Synthetic Content Forensics1 Aug 2025
- 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Models12 Jun 2025
- 2025AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detection29 Apr 2025
- 2025Manifold Induced Biases for Zero-shot and Few-shot Detection of Generated Images21 Apr 2025
- 2025MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillation13 Mar 2025
- 2025SFLD: Reducing the content bias for AI-generated Image Detection24 Feb 2025
- 2025Methods and Trends in Detecting AI-Generated Images: A Comprehensive Review21 Feb 2025
- 2025Stay-Positive: A Case for Ignoring Real Image Features in Fake Image Detection11 Feb 2025
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detection23 Nov 2024
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectors6 Nov 2024
- 2024HyperDet: Generalizable Detection of Synthesized Images by Generating and Merging A Mixture of Hyper LoRAs8 Oct 2024
- 2024Detect Fake with Fake: Leveraging Synthetic Data-driven Representation for Synthetic Image Detection13 Sep 2024
- 2024ForgeLens: Data-Efficient Forgery Focus for Generalizable Forgery Image Detection25 Aug 2024
- 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detection19 Aug 2024
- 2024Real-Time Deepfake Detection in the Real-World13 Jun 2024
- 2024SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flow30 May 2024
- 2024Automatic Controllable Colorization via Imagination8 Apr 2024
- 2024Mixture of Low-rank Experts for Transferable AI-Generated Image Detection7 Apr 2024
- 2024D3: Scaling Up Deepfake Detection by Learning from Discrepancy6 Apr 2024
- 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detection29 Feb 2024
- 2024Diverse Part Synthesis for 3D Shape Creation17 Jan 2024
- 2023GenDet: Towards Good Generalizations for AI-Generated Image Detection12 Dec 2023
- 2023Ten Years of Generative Adversarial Nets (GANs): A survey of the state-of-the-art30 Aug 2023
- 2023Inferring and Leveraging Parts from Object Shape for Improving Semantic Image Synthesis31 May 2023
- 2023Generalizable Synthetic Image Detection via Language-guided Contrastive Learning23 May 2023
- 2023Level Up the Deepfake Detection: a Method to Effectively Discriminate Images Generated by GAN Architectures and Diffusion Models1 Mar 2023
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Models20 Feb 2023
- 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Models13 Oct 2022
- 2022Semantic Image Synthesis via Diffusion Models30 Jun 2022
- 2022A Continual Deepfake Detection Benchmark: Dataset, Methods, and Essentials11 May 2022
- 2022BlobGAN: Spatially Disentangled Scene Representations5 May 2022
- 2022Retrieval-based Spatially Adaptive Normalization for Semantic Image Synthesis6 Apr 2022
- 2022Towards Implicit Text-Guided 3D Shape Generation28 Mar 2022
- 2022Fusing Global and Local Features for Generalized AI-Synthesized Image Detection26 Mar 2022
- 2022Stay Positive: Non-Negative Image Synthesis for Augmented Reality1 Feb 2022
- 2021A-PixelHop: A Green, Robust and Explainable Fake-Image Detector7 Nov 2021
- 2021Image Synthesis via Semantic Composition15 Sep 2021
- 2021Towards Photorealistic Colorization by Imagination20 Aug 2021
50 newest of 60 All 60 (JSON)
- 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 168
- 2022Semantic Image Synthesis via Diffusion Modelscited by 132
- 2023Generalizable Synthetic Image Detection via Language-guided Contrastive Learningcited by 49
- 2025MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillationcited by 31
- 2023Level Up the Deepfake Detection: a Method to Effectively Discriminate Images Generated by GAN Architectures and Diffusion Modelscited by 21
- 2024SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flowcited by 20
- 2025Methods and Trends in Detecting AI-Generated Images: A Comprehensive Reviewcited by 12
- 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Modelscited by 8
- 2026PGC: Peak-Guided Calibration for Generalizable AI-Generated Image Detectioncited by 6
- 2026PGC: Peak-Guided Calibration for Generalizable AI-Generated Image Detection20 May 2026
- 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Models12 Jun 2025
- 2025MoFlow: One-Step Flow Matching for Human Trajectory Forecasting via Implicit Maximum Likelihood Estimation based Distillation13 Mar 2025
- 2025Methods and Trends in Detecting AI-Generated Images: A Comprehensive Review21 Feb 2025
- 2024SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flow30 May 2024
- 2023Generalizable Synthetic Image Detection via Language-guided Contrastive Learning23 May 2023
- 2023Level Up the Deepfake Detection: a Method to Effectively Discriminate Images Generated by GAN Architectures and Diffusion Models1 Mar 2023
- 2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Models13 Oct 2022
- 2022Semantic Image Synthesis via Diffusion Models30 Jun 2022
- 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 490
- 2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 113
- 2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 105
- 2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 89
- 2022Fusing Global and Local Features for Generalized AI-Synthesized Image Detectioncited by 88
- 2021A Closer Look at Fourier Spectrum Discrepancies for CNN-generated Images Detectioncited by 68
- 2022Towards Implicit Text-Guided 3D Shape Generationcited by 68
- 2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
- 2024Real-Time Deepfake Detection in the Real-Worldcited by 51
- 2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
- 2021Image Synthesis via Semantic Compositioncited by 45
- 2022A Continual Deepfake Detection Benchmark: Dataset, Methods, and Essentialscited by 45
12 most cited of 49 All 49 (JSON)
- 2026FakeI2V-Bench: Benchmarking the Applicability of Image-level Deepfake Detectors for Deepfake Video Detection4 Aug 2026
- 2026Do Transformations Reveal the Truth? Generative Residual Learning for Generalized AI-Generated Image Detection9 Jul 2026
- 2026When Detectors Forget Forensics: Blocking Semantic Shortcuts for Generalizable AI-Generated Image Detection10 Mar 2026
- 2026RealStats: A Rigorous Real-Only Statistical Framework for Fake Image Detection26 Jan 2026
- 2025AI-Generated Image Detection: An Empirical Study and Future Research Directions4 Nov 2025
- 2025Semantic-Aware Reconstruction Error for Detecting AI-Generated Images13 Aug 2025
- 2025Leveraging Failed Samples: A Few-Shot and Training-Free Framework for Generalized Deepfake Detection13 Aug 2025
- 2025Towards Generalizable AI-Generated Image Detection via Image-Adaptive Prompt Learning3 Aug 2025
- 2025MiraGe: Multimodal Discriminative Representation Learning for Generalizable AI-Generated Image Detection3 Aug 2025
- 2025Unraveling Hidden Representations: A Multi-Modal Layer Analysis for Better Synthetic Content Forensics1 Aug 2025
- 2025AI-GenBench: A New Ongoing Benchmark for AI-Generated Image Detection29 Apr 2025
- 2025Manifold Induced Biases for Zero-shot and Few-shot Detection of Generated Images21 Apr 2025
12 newest of 49 All 49 (JSON)