mlsanityData to 14 Oct 2026

coDrawAgents: A Multi-Agent Dialogue Framework for Compositional Image Generation

arXiv 2603.12829 ↗First posted 13 Mar 2026cs.CVcited by 7

Not on the map. Why?

Abstract (arXiv)

Text-to-image generation has advanced rapidly, but existing models still struggle with faithfully composing multiple objects and preserving their attributes in complex scenes. We propose coDrawAgents, an interactive multi-agent dialogue framework with four specialized agents: Interpreter, Planner, Checker, and Painter that collaborate to improve compositional generation. The Interpreter adaptively decides between a direct text-to-image pathway and a layout-aware multi-agent process. In the layout-aware mode, it parses the prompt into attribute-rich object descriptors, ranks them by semantic salience, and groups objects with the same semantic priority level for joint generation. Guided by the Interpreter, the Planner adopts a divide-and-conquer strategy, incrementally proposing layouts for objects with the same semantic priority level while grounding decisions in the evolving visual context of the canvas. The Checker introduces an explicit error-correction mechanism by validating spatial consistency and attribute alignment, and refining layouts before they are rendered. Finally, the Painter synthesizes the image step by step, incorporating newly planned objects into the canvas to provide richer context for subsequent iterations. Together, these agents address three key challenges: reducing layout complexity, grounding planning in visual context, and enabling explicit error correction. Extensive experiments on benchmarks GenEval and DPG-Bench demonstrate that coDrawAgents substantially improves text-image alignment, spatial accuracy, and attribute binding compared to existing methods.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 65 of its 71 references that are in the map. First posted on arXiv 13 Mar 2026.

Builds on

65 of 71 references.

References · 65

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  3. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  4. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
  5. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  6. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  7. 2021Zero-Shot Text-to-Image Generationcited by 4,288
  8. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  9. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  10. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
  11. 2025Qwen-Image Technical Reportcited by 1,044
  12. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
38 more
  1. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  2. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  3. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  4. 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
  5. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
  6. 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 694
  7. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
  8. 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 509
  9. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
  10. 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
  11. 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
  12. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
  13. 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 329
  14. 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
  15. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
  16. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
  17. 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
  18. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
  19. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
  20. 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
  21. 2025Seedream 3.0 Technical Reportcited by 154
  22. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
  23. 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
  24. 2023Self-correcting LLM-controlled Diffusion Modelscited by 113
  25. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
  26. 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
  27. 2020Improving Image Captioning with Better Use of Captionscited by 84
  28. 2024Be Yourself: Bounded Attention for Multi-Subject Text-to-Image Generationcited by 69
  29. 2023DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedbackcited by 58
  30. 2023LLM Blueprint: Enabling Text-to-Image Generation with Complex and Detailed Promptscited by 54
  31. 2024HiCo: Hierarchical Controllable Diffusion Model for Layout-to-image Generationcited by 41
  32. 20243DIS: Depth-Driven Decoupled Instance Synthesis for Text-to-Image Generationcited by 37
  33. 2024Parrot: Pareto-optimal Multi-Reward Reinforcement Learning Framework for Text-to-Image Generationcited by 36
  34. 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generationcited by 33
  35. 2023SSMG: Spatial-Semantic Map Guided Diffusion Model for Free-form Layout-to-Image Generationcited by 29
  36. 2024Proactive Agents for Multi-Turn Text-to-Image Generation Under Uncertaintycited by 25
  37. 2025MCCD: Multi-Agent Collaboration-based Compositional Diffusion for Complex Text-to-Image Generationcited by 23
  38. 20253DIS-FLUX: simple and efficient multi-instance generation with DiT renderingcited by 21

50 most cited of 65 All 65 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.