Learning to Generate Images of Outdoor Scenes from Attributes and Semantic Layouts
Not on the map. Why?
Abstract (arXiv)
Automatic image synthesis research has been rapidly growing with deep networks getting more and more expressive. In the last couple of years, we have observed images of digits, indoor scenes, birds, chairs, etc. being automatically generated. The expressive power of image generators have also been enhanced by introducing several forms of conditioning variables such as object names, sentences, bounding box and key-point locations. In this work, we propose a novel deep conditional generative adversarial network architecture that takes its strength from the semantic layout and scene attributes integrated as conditioning variables. We show that our architecture is able to generate realistic outdoor scene images under different conditions, e.g. day-night, sunny-foggy, with clear object boundaries.
Key facts. Cited by 21 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Dec 2016.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2020: 1; 2021: 8; 2022: 4; 2023: 6; 2024: 0; 2025: 2.
21 papers.
Sort:
By area:
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 44
- 2023DiffFacto: Controllable Part-Based 3D Point Cloud Generation with Cross Diffusioncited by 32
- 2021View Generalization for Single Image Textured 3D Modelscited by 19
- 2021PanoDR: Spherical Panorama Diminished Reality for Indoor Scenescited by 13
- 2025A Diffusion Model Translator for Efficient Image-to-Image Translationcited by 12
- 2021AttrLostGAN: Attribute Controlled Image Synthesis from Reconfigurable Layout and Stylecited by 11
- 2025DC-ControlNet: Decoupling Inter- and Intra-Element Conditions in Image Generation with Diffusion Modelscited by 10
- 2022Maximum Spatial Perturbation Consistency for Unpaired Image-to-Image Translationcited by 8
- 2023FASTER: A Font-Agnostic Scene Text Editing and Rendering Frameworkcited by 6
- 2023Domain Adaptation of Synthetic Driving Datasets for Real-World Autonomous Drivingcited by 4
- 2021DCL: Differential Contrastive Learning for Geometry-Aware Depth Synthesiscited by 3
9 more
- 2021Harnessing the Conditioning Sensorium for Improved Image Translationcited by 3
- 2022Rethinking Machine Learning Robustness via its Link with the Out-of-Distribution Problemcited by 2
- 2022How to Guide Adaptive Depth Sampling?cited by 2
- 2022An Architecture for the detection of GAN-generated Flood Images with Localization Capabilitiescited by 1
- 2020Why Adversarial Interaction Creates Non-Homogeneous Patterns: A Pseudo-Reaction-Diffusion Model for Turing Instabilitycited by 0
- 2021Adaptive Appearance Renderingcited by 0
- 2021Style-Restricted GAN: Multi-Modal Translation with Style Restriction Using Generative Adversarial Networkscited by 0
- 2021Cascading Modular Network (CAM-Net) for Multimodal Image Synthesiscited by 0
- 2023AptSim2Real: Approximately-Paired Sim-to-Real Image Translationcited by 0
- 2025DC-ControlNet: Decoupling Inter- and Intra-Element Conditions in Image Generation with Diffusion Models20 Feb 2025
- 2025A Diffusion Model Translator for Efficient Image-to-Image Translation1 Feb 2025
- 2023FASTER: A Font-Agnostic Scene Text Editing and Rendering Framework5 Aug 2023
- 2023DiffFacto: Controllable Part-Based 3D Point Cloud Generation with Cross Diffusion3 May 2023
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoders12 Apr 2023
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation30 Mar 2023
- 2023AptSim2Real: Approximately-Paired Sim-to-Real Image Translation9 Mar 2023
- 2023Domain Adaptation of Synthetic Driving Datasets for Real-World Autonomous Driving8 Feb 2023
- 2022How to Guide Adaptive Depth Sampling?20 May 2022
- 2022An Architecture for the detection of GAN-generated Flood Images with Localization Capabilities14 May 2022
- 2022Maximum Spatial Perturbation Consistency for Unpaired Image-to-Image Translation23 Mar 2022
- 2022Rethinking Machine Learning Robustness via its Link with the Out-of-Distribution Problem18 Feb 2022
9 more
- 2021Harnessing the Conditioning Sensorium for Improved Image Translation13 Oct 2021
- 2021DCL: Differential Contrastive Learning for Geometry-Aware Depth Synthesis27 Jul 2021
- 2021Cascading Modular Network (CAM-Net) for Multimodal Image Synthesis16 Jun 2021
- 2021View Generalization for Single Image Textured 3D Models10 Jun 2021
- 2021PanoDR: Spherical Panorama Diminished Reality for Indoor Scenes1 Jun 2021
- 2021Style-Restricted GAN: Multi-Modal Translation with Style Restriction Using Generative Adversarial Networks17 May 2021
- 2021Adaptive Appearance Rendering24 Apr 2021
- 2021AttrLostGAN: Attribute Controlled Image Synthesis from Reconfigurable Layout and Style25 Mar 2021
- 2020Why Adversarial Interaction Creates Non-Homogeneous Patterns: A Pseudo-Reaction-Diffusion Model for Turing Instability1 Oct 2020
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoderscited by 44
- 2025A Diffusion Model Translator for Efficient Image-to-Image Translationcited by 12
- 2025DC-ControlNet: Decoupling Inter- and Intra-Element Conditions in Image Generation with Diffusion Modelscited by 10
- 2020Why Adversarial Interaction Creates Non-Homogeneous Patterns: A Pseudo-Reaction-Diffusion Model for Turing Instabilitycited by 0
- 2025DC-ControlNet: Decoupling Inter- and Intra-Element Conditions in Image Generation with Diffusion Models20 Feb 2025
- 2025A Diffusion Model Translator for Efficient Image-to-Image Translation1 Feb 2025
- 2023Improving Diffusion Models for Scene Text Editing with Dual Encoders12 Apr 2023
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation30 Mar 2023
- 2020Why Adversarial Interaction Creates Non-Homogeneous Patterns: A Pseudo-Reaction-Diffusion Model for Turing Instability1 Oct 2020
- 2023DiffFacto: Controllable Part-Based 3D Point Cloud Generation with Cross Diffusioncited by 32
- 2021View Generalization for Single Image Textured 3D Modelscited by 19
- 2021PanoDR: Spherical Panorama Diminished Reality for Indoor Scenescited by 13
- 2021AttrLostGAN: Attribute Controlled Image Synthesis from Reconfigurable Layout and Stylecited by 11
- 2022Maximum Spatial Perturbation Consistency for Unpaired Image-to-Image Translationcited by 8
- 2023FASTER: A Font-Agnostic Scene Text Editing and Rendering Frameworkcited by 6
- 2023Domain Adaptation of Synthetic Driving Datasets for Real-World Autonomous Drivingcited by 4
- 2021DCL: Differential Contrastive Learning for Geometry-Aware Depth Synthesiscited by 3
- 2021Harnessing the Conditioning Sensorium for Improved Image Translationcited by 3
- 2022Rethinking Machine Learning Robustness via its Link with the Out-of-Distribution Problemcited by 2
- 2022How to Guide Adaptive Depth Sampling?cited by 2
- 2022An Architecture for the detection of GAN-generated Flood Images with Localization Capabilitiescited by 1
12 most cited of 16 All 16 (JSON)
- 2023FASTER: A Font-Agnostic Scene Text Editing and Rendering Framework5 Aug 2023
- 2023DiffFacto: Controllable Part-Based 3D Point Cloud Generation with Cross Diffusion3 May 2023
- 2023AptSim2Real: Approximately-Paired Sim-to-Real Image Translation9 Mar 2023
- 2023Domain Adaptation of Synthetic Driving Datasets for Real-World Autonomous Driving8 Feb 2023
- 2022How to Guide Adaptive Depth Sampling?20 May 2022
- 2022An Architecture for the detection of GAN-generated Flood Images with Localization Capabilities14 May 2022
- 2022Maximum Spatial Perturbation Consistency for Unpaired Image-to-Image Translation23 Mar 2022
- 2022Rethinking Machine Learning Robustness via its Link with the Out-of-Distribution Problem18 Feb 2022
- 2021Harnessing the Conditioning Sensorium for Improved Image Translation13 Oct 2021
- 2021DCL: Differential Contrastive Learning for Geometry-Aware Depth Synthesis27 Jul 2021
- 2021Cascading Modular Network (CAM-Net) for Multimodal Image Synthesis16 Jun 2021
- 2021View Generalization for Single Image Textured 3D Models10 Jun 2021
12 newest of 16 All 16 (JSON)