mlsanityData to 7 Oct 2026

Image Synthesis via Semantic Composition

arXiv 2109.07053 ↗First posted 15 Sep 2021cs.CVcited by 45

Not on the map. Why?

Abstract (arXiv)

In this paper, we present a novel approach to synthesize realistic images based on their semantic layouts. It hypothesizes that for objects with similar appearance, they share similar representation. Our method establishes dependencies between regions according to their appearance correlation, yielding both spatially variant and associated representations. Conditioning on these features, we propose a dynamic weighted network constructed by spatially conditional computation (with both convolution and normalization). More than preserving semantic distinctions, the given dynamic network strengthens semantic relevance, benefiting global structure and detail synthesis. We demonstrate that our method gives the compelling generation performance qualitatively and quantitatively with extensive experiments on benchmarks.

Key facts. Cited by 45 papers in the map (data through 7 Oct 2026). Builds on 41 of its 52 references that are in the map. First posted on arXiv 15 Sep 2021.

Builds on

41 of 52 references.

References · 41

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
  5. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
  6. 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
  7. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
  8. 2017Non-local Neural Networkscited by 2,290
  9. 2014Conditional Generative Adversarial Netscited by 2,152
  10. 2018Spectral Normalization for Generative Adversarial Networkscited by 1,618
  11. 2017Deformable Convolutional Networkscited by 1,481
  12. 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,295
29 more
  1. 2018Unified Perceptual Parsing for Scene Understandingcited by 1,265
  2. 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
  3. 2016HyperNetworkscited by 1,003
  4. 2016COCO-Stuff: Thing and Stuff Classes in Contextcited by 858
  5. 2018Self-Attention Generative Adversarial Networkscited by 809
  6. 2018Multimodal Unsupervised Image-to-Image Translationcited by 795
  7. 2017Unpaired Image-to-Image Translation using Cycle-Consistent Adversarial Networkscited by 707
  8. 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 624
  9. 2018Generative Image Inpainting with Contextual Attentioncited by 578
  10. 2016Dynamic Filter Networkscited by 318
  11. 2017Dilated Residual Networkscited by 293
  12. 2019CondConv: Conditionally Parameterized Convolutions for Efficient Inferencecited by 273
  13. 2019SEAN: Image Synthesis with Semantic Region-Adaptive Normalizationcited by 253
  14. 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
  15. 2019Meta-SR: A Magnification-Arbitrary Network for Super-Resolutioncited by 180
  16. 2020You Only Need Adversarial Supervision for Semantic Image Synthesiscited by 129
  17. 2019Learning to Predict Layout-to-image Conditional Convolutions for Semantic Image Synthesiscited by 108
  18. 2019Multi-Channel Attention Selection GAN with Cascaded Semantic Guidance for Cross-View Image Translationcited by 97
  19. 2018Image Inpainting via Generative Multi-column Convolutional Neural Networkscited by 81
  20. 2019Local Class-Specific and Global Image-Level Generative Adversarial Networks for Semantic-Guided Scene Generationcited by 75
  21. 2020TSIT: A Simple and Versatile Framework for Image-to-Image Translationcited by 64
  22. 2018Diverse Image Synthesis from Semantic Layouts via Conditional IMLEcited by 60
  23. 2018Semi-parametric Image Synthesiscited by 50
  24. 2020Dynamic Region-Aware Convolutioncited by 49
  25. 2019Multi-mapping Image-to-Image Translation via Learning Disentanglementcited by 35
  26. 2020VCNet: A Robust Approach to Blind Image Inpaintingcited by 25
  27. 2018MetaAnchor: Learning to Detect Objects with Customized Anchorscited by 21
  28. 2020PointINS: Point-based Instance Segmentationcited by 17
  29. 2020Attentive Normalization for Conditional Image Generationcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 10; 2023: 15; 2024: 11; 2025: 6; 2026: 1.

45 papers.

Sort:

By area:

  1. 2023Flow Matching in Latent Spacecited by 155
  2. 2022Semantic Image Synthesis via Diffusion Modelscited by 131
  3. 2025Cosmos-Transfer1: Conditional World Generation with Adaptive Multimodal Controlcited by 95
  4. 2023Freestyle Layout-to-Image Synthesiscited by 67
  5. 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
  6. 2023SSMG: Spatial-Semantic Map Guided Diffusion Model for Free-form Layout-to-Image Generationcited by 29
  7. 2023UniGS: Unified Representation for Image Generation and Segmentationcited by 29
  8. 2022DynaST: Dynamic Sparse Transformer for Exemplar-Guided Image Generationcited by 24
  9. 2024PLACE: Adaptive Layout-Semantic Fusion for Semantic Image Synthesiscited by 20
  10. 2024SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flowcited by 20
  11. 2024Adversarial Supervision Makes Layout-to-Image Diffusion Models Thrivecited by 18
  12. 2022Semantic-shape Adaptive Feature Modulation for Semantic Image Synthesiscited by 16
33 more
  1. 2022Retrieval-based Spatially Adaptive Normalization for Semantic Image Synthesiscited by 15
  2. 2022PalGAN: Image Colorization with Palette Generative Adversarial Networkscited by 15
  3. 2024DiffuMatting: Synthesizing Arbitrary Objects with Matting-level Annotationcited by 13
  4. 2023Exploring the Application of Large-scale Pre-trained Models on Adverse Weather Removalcited by 12
  5. 2022SCAM! Transferring humans between images with Semantic Cross Attention Modulationcited by 10
  6. 2023Text-guided Eyeglasses Manipulation with Spatial Constraintscited by 10
  7. 2024Stochastic Conditional Diffusion Models for Robust Semantic Image Synthesiscited by 10
  8. 2023Conditioning Diffusion Models via Attributes and Semantic Masks for Face Generationcited by 9
  9. 2023Learning 3D Photography Videos via Self-supervised Diffusion on Single Imagescited by 8
  10. 2023Edge Guided GANs with Multi-Scale Contrastive Learning for Semantic Image Synthesiscited by 8
  11. 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Modelscited by 8
  12. 2023Enhancing Object Coherence in Layout-to-Image Synthesiscited by 7
  13. 2024SCP-Diff: Spatial-Categorical Joint Prior for Diffusion Based Semantic Image Synthesiscited by 7
  14. 2024MM2Latent: Text-to-facial image generation and editing in GANs with multimodal assistancecited by 7
  15. 2021DRAN: Detailed Region-Adaptive Normalization for Conditional Image Synthesiscited by 6
  16. 2022PixelFolder: An Efficient Progressive Pixel Synthesis Network for Image Generationcited by 5
  17. 2023Controllable Image Generation via Collage Representationscited by 5
  18. 2023Automatic Generation of Semantic Parts for Face Image Synthesiscited by 5
  19. 2023Semantic Image Synthesis via Class-Adaptive Cross-Attentioncited by 5
  20. 2022APRNet: Attention-based Pixel-wise Rendering Network for Photo-Realistic Text Image Generationcited by 3
  21. 2024Semantic Image Synthesis with Unconditional Generatorcited by 3
  22. 2024IIDM: Image-to-Image Diffusion Model for Semantic Image Synthesiscited by 3
  23. 2024Label-free Neural Semantic Image Synthesiscited by 3
  24. 2023Inferring and Leveraging Parts from Object Shape for Improving Semantic Image Synthesiscited by 2
  25. 2022Discovering Class-Specific GAN Controls for Semantic Image Synthesiscited by 1
  26. 2022Unifying conditional and unconditional semantic image synthesis with OCO-GANcited by 0
  27. 2023Referenceless User Controllable Semantic Image Synthesiscited by 0
  28. 2024Reconciling Semantic Controllability and Diversity for Remote Sensing Image Synthesis with Hybrid Semantic Embeddingcited by 0
  29. 2025StructDiff: Structure-aware Diffusion Model for 3D Fine-grained Medical Image Synthesiscited by 0
  30. 2025PartStickers: Generating Parts of Objects for Rapid Prototypingcited by 0
  31. 2025AnatoMaskGAN: GNN-Driven Slice Feature Fusion and Noise Augmentation for Medical Semantic Image Synthesiscited by 0
  32. 2025SISMA: Semantic Face Image Synthesis with Mambacited by 0
  33. 2026InstancePin: Instance-Addressable Layout-to-Image Diffusion via Coordinate Pinningcited by 0