Data to 7 Oct 2026

Photographic Image Synthesis with Cascaded Refinement Networks

arXiv 1707.09405 ↗First posted 28 Jul 2017cs.CV cs.AI cs.GRcited by 223

Not on the map. Why?

Abstract (arXiv)

We present an approach to synthesizing photographic images conditioned on semantic layouts. Given a semantic label map, our approach produces an image with photographic appearance that conforms to the input layout. The approach thus functions as a rendering engine that takes a two-dimensional semantic specification of the scene and produces a corresponding photographic image. Unlike recent and contemporaneous work, our approach does not rely on adversarial training. We show that photographic images can be synthesized from semantic layouts by a single feedforward network with appropriate structure, trained end-to-end with a direct regression objective. The presented approach scales seamlessly to high resolutions; we demonstrate this by synthesizing photographic images at 2-megapixel resolution, the full resolution of our training data. Extensive perceptual experiments on datasets of outdoor and indoor scenes demonstrate that images synthesized by the presented approach are considerably more realistic than alternative approaches. The results are shown in the supplementary video at https://youtu.be/0fhUJT21-bs

Key facts. Cited by 223 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Jul 2017.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 73; 2022: 54; 2023: 30; 2024: 34; 2025: 19; 2026: 13.

223 papers.

Sort:

By area:

2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
2024GS-LRM: Large Reconstruction Model for 3D Gaussian Splattingcited by 344
2023Diffusion Hyperfeatures: Searching Through Time and Space for Semantic Correspondencecited by 211
2021PeCo: Perceptual Codebook for BERT Pre-training of Vision Transformerscited by 204
2022DE-FAKE: Detection and Attribution of Fake Images Generated by Text-to-Image Generation Modelscited by 167
2023Dense Text-to-Image Generation with Attention Modulationcited by 162
2024MeshLRM: Large Reconstruction Model for High-Quality Meshescited by 138
2021UNIT-DDPM: UNpaired Image Translation with Denoising Diffusion Probabilistic Modelscited by 133
2022Semantic Image Synthesis via Diffusion Modelscited by 131
2021Seeing biodiversity: perspectives in machine learning for wildlife conservationcited by 129

38 more

2022Photorealistic Monocular 3D Reconstruction of Humans Wearing Clothingcited by 126
2021MSeg: A Composite Dataset for Multi-domain Semantic Segmentationcited by 122
2021Instance-Conditioned GANcited by 119
2024C2P-CLIP: Injecting Category Common Prompt in CLIP to Enhance Generalization in Deepfake Detectioncited by 111
2021One Shot Face Swapping on Megapixelscited by 105
2024Orthogonal Subspace Decomposition for Generalizable AI-Generated Image Detectioncited by 102
2021D2C: Diffusion-Denoising Models for Few-shot Conditional Generationcited by 96
2022Fusing Global and Local Features for Generalized AI-Synthesized Image Detectioncited by 88
2024Leveraging Representations from Intermediate Encoder-blocks for Synthetic Image Detectioncited by 88
2021Ensembling Off-the-shelf Models for GAN Trainingcited by 84
2021PixelSynth: Generating a 3D-Consistent Experience from a Single Imagecited by 82
2022Learning to generate line drawings that convey geometry and semanticscited by 82
2021GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Drivingcited by 75
2021Enhancing Photorealism Enhancementcited by 74
2021A Closer Look at Fourier Spectrum Discrepancies for CNN-generated Images Detectioncited by 68
2023Freestyle Layout-to-Image Synthesiscited by 67
2024Towards Realistic Scene Generation with LiDAR Diffusion Modelscited by 67
2021The Spatially-Correlative Loss for Various Image Translation Taskscited by 66
2021Dual Contrastive Learning for Unsupervised Image-to-Image Translationcited by 65
2022High-fidelity 3D GAN Inversion by Pseudo-multi-view Optimizationcited by 65
2021Image-to-image Translation via Hierarchical Style Disentanglementcited by 63
2022Single-View View Synthesis in the Wild with Learned Adaptive Multiplane Imagescited by 59
2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
2021Countering Malicious DeepFakes: Survey, Battleground, and Horizoncited by 56
2021High-Resolution Image Harmonization via Collaborative Dual Transformationscited by 55
2022Look Outside the Room: Synthesizing A Consistent Long-Term 3D Scene Video from A Single Imagecited by 55
2021Adversarial Text-to-Image Synthesis: A Reviewcited by 52
2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
2022DiffDreamer: Towards Consistent Unsupervised Single-view Scene Extrapolation with Conditional Diffusion Modelscited by 51
2024Community Forensics: Using Thousands of Generators to Train Fake Image Detectorscited by 50
2021Diverse Semantic Image Synthesis via Probability Distribution Modelingcited by 49
2022ArtFID: Quantitative Evaluation of Neural Style Transfercited by 49
2024Real-Time Deepfake Detection in the Real-Worldcited by 49
2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
2023Generalizable Synthetic Image Detection via Language-guided Contrastive Learningcited by 48
2021Instance-wise Hard Negative Example Generation for Contrastive Learning in Unpaired Image-to-Image Translationcited by 45
2021Image Synthesis via Semantic Compositioncited by 45
2022A Continual Deepfake Detection Benchmark: Dataset, Methods, and Essentialscited by 45

50 most cited of 223 All 223 (JSON)