mlsanityData to 7 Oct 2026

Semantically Multi-modal Image Synthesis

arXiv 2003.12697 ↗First posted 28 Mar 2020cs.CVcited by 58

Not on the map. Why?

Abstract (arXiv)

In this paper, we focus on semantically multi-modal image synthesis (SMIS) task, namely, generating multi-modal images at the semantic level. Previous work seeks to use multiple class-specific generators, constraining its usage in datasets with a small number of classes. We instead propose a novel Group Decreasing Network (GroupDNet) that leverages group convolutions in the generator and progressively decreases the group numbers of the convolutions in the decoder. Consequently, GroupDNet is armed with much more controllability on translating semantic labels to natural images and has plausible high-quality yields for datasets with many classes. Experiments on several challenging datasets demonstrate the superiority of GroupDNet on performing the SMIS task. We also show that GroupDNet is capable of performing a wide range of interesting synthesis applications. Codes and models are available at: https://github.com/Seanseattle/SMIS.

Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). First posted on arXiv 28 Mar 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 24; 2022: 10; 2023: 11; 2024: 8; 2025: 4; 2026: 1.

58 papers.

Sort:

By area:

  1. 2021GAN Inversion: A Surveycited by 366
  2. 2022Semantic Image Synthesis via Diffusion Modelscited by 131
  3. 2021Defect-GAN: High-Fidelity Defect Synthesis for Automated Defect Inspectioncited by 77
  4. 2023Freestyle Layout-to-Image Synthesiscited by 67
  5. 2021PISE: Person Image Synthesis and Editing with Decoupled GANcited by 62
  6. 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
  7. 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
  8. 2021Diverse Semantic Image Synthesis via Probability Distribution Modelingcited by 49
  9. 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
  10. 2021Unbalanced Feature Transport for Exemplar-based Image Translationcited by 41
  11. 2023Generative Semantic Communication: Diffusion Models Beyond Bit Recoverycited by 41
  12. 2021CoMoGAN: continuous model-guided image-to-image translationcited by 27
38 more
  1. 2021Styleformer: Transformer based Generative Adversarial Networks with Style Vectorcited by 27
  2. 2021Towards Open-World Text-Guided Face Image Generation and Manipulationcited by 25
  3. 2021FaceController: Controllable Attribute Editing for Face in the Wildcited by 22
  4. 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translationcited by 22
  5. 2021Bi-level Feature Alignment for Versatile Image Translation and Manipulationcited by 20
  6. 2024SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flowcited by 20
  7. 2022Marginal Contrastive Correspondence for Guided Image Generationcited by 19
  8. 2023Hierarchical Diffusion Autoencoders and Disentangled Image Manipulationcited by 18
  9. 2024Adversarial Supervision Makes Layout-to-Image Diffusion Models Thrivecited by 18
  10. 2022SCAM! Transferring humans between images with Semantic Cross Attention Modulationcited by 10
  11. 2024Stochastic Conditional Diffusion Models for Robust Semantic Image Synthesiscited by 10
  12. 2021Physics-informed Guided Disentanglement in Generative Networkscited by 9
  13. 2022Auto-regressive Image Synthesis with Integrated Quantizationcited by 9
  14. 2021Deep Image Synthesis from Intuitive User Input: A Review and Perspectivescited by 8
  15. 2021Layout-to-Image Translation with Double Pooling Generative Adversarial Networkscited by 8
  16. 2022Local and Global GANs with Semantic-Aware Upsampling for Image Generationcited by 8
  17. 2023Edge Guided GANs with Multi-Scale Contrastive Learning for Semantic Image Synthesiscited by 8
  18. 2024EBDM: Exemplar-guided Image Translation with Brownian-bridge Diffusion Modelscited by 8
  19. 2023Enhancing Object Coherence in Layout-to-Image Synthesiscited by 7
  20. 2024SCP-Diff: Spatial-Categorical Joint Prior for Diffusion Based Semantic Image Synthesiscited by 7
  21. 2024MM2Latent: Text-to-facial image generation and editing in GANs with multimodal assistancecited by 7
  22. 2021DRAN: Detailed Region-Adaptive Normalization for Conditional Image Synthesiscited by 6
  23. 2021ManiFest: Manifold Deformation for Few-shot Image Translationcited by 6
  24. 2022DeepPortraitDrawing: Generating Human Body Images from Freehand Sketchescited by 5
  25. 2023Semantic Image Synthesis via Class-Adaptive Cross-Attentioncited by 5
  26. 2023Diff-GO: Diffusion Goal-Oriented Communications to Achieve Ultra-High Spectrum Efficiencycited by 5
  27. 2021Few-shot Semantic Image Synthesis Using StyleGAN Priorcited by 4
  28. 2021Controllable Person Image Synthesis with Spatially-Adaptive Warped Normalizationcited by 4
  29. 2021Smart Fashion: A Review of AI Applications in the Fashion & Apparel Industrycited by 4
  30. 2023Disentangled Representation Learning for Controllable Person Image Generationcited by 4
  31. 2023Controllable Multi-domain Semantic Artwork Synthesiscited by 2
  32. 2021Diversifying Semantic Image Synthesis and Editing via Class- and Layer-wise VAEscited by 1
  33. 2021Towards Controllable and Photorealistic Region-wise Image Manipulationcited by 1
  34. 2021Leveraging Local Domains for Image-to-Image Translationcited by 1
  35. 2022Unsupervised Structure-Consistent Image-to-Image Translationcited by 1
  36. 2022Discovering Class-Specific GAN Controls for Semantic Image Synthesiscited by 1
  37. 2024LaMI-GO: Latent Mixture Integration for Goal-Oriented Communications Achieving High Spectrum Efficiencycited by 1
  38. 2021Realistic Image Synthesis with Configurable 3D Scene Layoutscited by 0

50 most cited of 58 All 58 (JSON)