mlsanityData to 7 Oct 2026

ChatPainter: Improving Text to Image Generation using Dialogue

arXiv 1802.08216 ↗First posted 22 Feb 2018cs.CVcited by 18

Not on the map. Why?

Abstract (arXiv)

Synthesizing realistic images from text descriptions on a dataset like Microsoft Common Objects in Context (MS COCO), where each image can contain several objects, is a challenging task. Prior work has used text captions to generate images. However, captions might not be informative enough to capture the entire image and insufficient for the model to be able to understand which objects in the images correspond to which words in the captions. We show that adding a dialogue that further describes the scene leads to significant improvement in the inception score and in the quality of generated images on the MS COCO dataset.

Key facts. Cited by 18 papers in the map (data through 7 Oct 2026). First posted on arXiv 22 Feb 2018.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 6; 2022: 6; 2023: 3; 2024: 3.

18 papers.

Sort:

By area:

  1. 2022Scaling Autoregressive Models for Content-Rich Text-to-Image Generationcited by 1,287
  2. 2021Vector Quantized Diffusion Model for Text-to-Image Synthesiscited by 773
  3. 2022A Comprehensive Survey of Few-shot Learning: Evolution, Applications, Challenges, and Opportunitiescited by 162
  4. 2021Talk-to-Edit: Fine-Grained Facial Editing via Dialogcited by 102
  5. 2022Synthetic Data -- what, why and how?cited by 66
  6. 2021Adversarial Text-to-Image Synthesis: A Reviewcited by 52
  7. 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
  8. 20223DALL-E: Integrating Text-to-Image AI in 3D Design Workflowscited by 41
  9. 2023CHATEDIT: Towards Multi-turn Interactive Facial Image Editing via Dialoguecited by 12
  10. 2024AesopAgent: Agent-driven Evolutionary System on Story-to-Video Productioncited by 12
  11. 2023Vision + Language Applications: A Surveycited by 8
  12. 2021Iconary: A Pictionary-Based Game for Testing Multimodal Communication with Drawings and Textcited by 6
6 more
  1. 2022Adma-GAN: Attribute-Driven Memory Augmented GANs for Text-to-Image Generationcited by 6
  2. 2023ALR-GAN: Adaptive Layout Refinement for Text-to-Image Synthesiscited by 4
  3. 2022IR-GAN: Image Manipulation with Linguistic Instruction by Increment Reasoningcited by 3
  4. 2024BlendScape: Enabling End-User Customization of Video-Conferencing Environments through Generative AIcited by 3
  5. 2021Fine-Grained Image Generation from Bangla Text Description using Attentional Generative Adversarial Networkcited by 1
  6. 2024Offline Evaluation of Set-Based Text-to-Image Generationcited by 1