mlsanityData to 7 Oct 2026

Photographic Text-to-Image Synthesis with a Hierarchically-nested Adversarial Network

arXiv 1802.09178 ↗First posted 26 Feb 2018cs.CVcited by 64

Not on the map. Why?

Abstract (arXiv)

This paper presents a novel method to deal with the challenging task of generating photographic images conditioned on semantic image descriptions. Our method introduces accompanying hierarchical-nested adversarial objectives inside the network hierarchies, which regularize mid-level representations and assist generator training to capture the complex image statistics. We present an extensile single-stream generator architecture to better adapt the jointed discriminators and push generated images up to high resolutions. We adopt a multi-purpose adversarial loss to encourage more effective image and text information usage in order to improve the semantic consistency and image fidelity simultaneously. Furthermore, we introduce a new visual-semantic similarity measure to evaluate the semantic consistency of generated images. With extensive experimental validation on three public datasets, our method significantly improves previous state of the arts on all datasets over different evaluation metrics.

Key facts. Cited by 64 papers in the map (data through 7 Oct 2026). First posted on arXiv 26 Feb 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 17; 2022: 17; 2023: 23; 2024: 4; 2025: 2; 2026: 1.

64 papers.

Sort:

By area:

  1. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,286
  2. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  3. 2021Blended Diffusion for Text-driven Editing of Natural Imagescited by 924
  4. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  5. 2021Cross-Modal Contrastive Learning for Text-to-Image Generationcited by 259
  6. 2022Diffsound: Discrete Diffusion Model for Text-to-sound Generationcited by 256
  7. 2021Paint by Wordcited by 107
  8. 2024DiT4Edit: Diffusion Transformer for Image Editingcited by 100
  9. 2023IconShop: Text-Guided Vector Icon Synthesis with Autoregressive Transformerscited by 73
  10. 2022Synthetic Data -- what, why and how?cited by 66
  11. 2023Toward Verifiable and Reproducible Human Evaluation for Text-to-Image Generationcited by 66
  12. 2021Improving Text-to-Image Synthesis Using Contrastive Learningcited by 62
38 more
  1. 2022Improved Vector Quantized Diffusion Modelscited by 62
  2. 2023Unified Multi-Modal Latent Diffusion for Joint Subject and Text Conditional Image Generationcited by 60
  3. 2021Text to Image Generation with Semantic-Spatial Aware GANcited by 53
  4. 2021Adversarial Text-to-Image Synthesis: A Reviewcited by 52
  5. 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
  6. 2023RenAIssance: A Survey into AI Text-to-Image Generation in the Era of Large Modelcited by 47
  7. 2023SceneGenie: Scene Graph Guided Diffusion Models for Image Synthesiscited by 41
  8. 2023Highly Personalized Text Embedding for Image Manipulation by Stable Diffusioncited by 39
  9. 2023Object-aware Inversion and Reassembly for Image Editingcited by 29
  10. 2023Gradient-Free Textual Inversioncited by 28
  11. 2023Multi-modal Machine Learning in Engineering Design: A Review and Future Directionscited by 27
  12. 2023DreamIdentity: Improved Editability for Efficient Face-identity Preserved Image Generationcited by 26
  13. 2022One Model to Edit Them All: Free-Form Text-Driven Image Manipulation with Semantic Modulationscited by 24
  14. 2023Iterative Multi-granular Image Editing using Diffusion Modelscited by 20
  15. 2023Attribute-Centric Compositional Text-to-Image Generationcited by 19
  16. 2022Avocodo: Generative Adversarial Network for Artifact-free Vocodercited by 18
  17. 2022ARMANI: Part-level Garment-Text Alignment for Unified Cross-Modal Fashion Designcited by 16
  18. 2023MagicFusion: Boosting Text-to-Image Generation Performance by Fusing Diffusion Modelscited by 16
  19. 2023DomainStudio: Fine-Tuning Diffusion Models for Domain-Driven Image Generation using Limited Datacited by 15
  20. 2021Perspectives and Prospects on Transformer Architecture for Cross-Modal Tasks with Language and Visioncited by 14
  21. 2021CRD-CGAN: Category-Consistent and Relativistic Constraints for Diverse Text-to-Image Generationcited by 10
  22. 2022DR-GAN: Distribution Regularization for Text-to-Image Generationcited by 10
  23. 2023Discriminative Class Tokens for Text-to-Image Diffusion Modelscited by 9
  24. 2021Deep Image Synthesis from Intuitive User Input: A Review and Perspectivescited by 8
  25. 2023Vision + Language Applications: A Surveycited by 8
  26. 2023CogCartoon: Towards Practical Story Visualizationcited by 8
  27. 2021MIGS: Meta Image Generation from Scene Graphscited by 7
  28. 2022AI Illustrator: Translating Raw Descriptions into Images by Prompt-based Cross-Modal Generationcited by 7
  29. 2023The Big Data Myth: Using Diffusion Models for Dataset Generation to Train Deep Detection Modelscited by 7
  30. 2023Learning Profitable NFT Image Diffusions via Multiple Visual-Policy Guided Reinforcement Learningcited by 7
  31. 2022Adma-GAN: Attribute-Driven Memory Augmented GANs for Text-to-Image Generationcited by 6
  32. 2023Fine-grained Cross-modal Fusion based Refinement for Text-to-Image Synthesiscited by 6
  33. 2022PixelFolder: An Efficient Progressive Pixel Synthesis Network for Image Generationcited by 5
  34. 2022Vision-Language Matching for Text-to-Image Synthesis via Generative Adversarial Networkscited by 5
  35. 2022T-Person-GAN: Text-to-Person Image Generation with Identity-Consistency and Manifold Mix-Upcited by 4
  36. 2023ALR-GAN: Adaptive Layout Refinement for Text-to-Image Synthesiscited by 4
  37. 2021Generative Models Improve Radiomics Reproducibility in Low Dose CTs: A Simulation Studycited by 3
  38. 2024Deep Multi-Task Learning for Malware Image Classificationcited by 3

50 most cited of 64 All 64 (JSON)