coDrawAgents: A Multi-Agent Dialogue Framework for Compositional Image Generation
Not on the map. Why?
Abstract (arXiv)
Text-to-image generation has advanced rapidly, but existing models still struggle with faithfully composing multiple objects and preserving their attributes in complex scenes. We propose coDrawAgents, an interactive multi-agent dialogue framework with four specialized agents: Interpreter, Planner, Checker, and Painter that collaborate to improve compositional generation. The Interpreter adaptively decides between a direct text-to-image pathway and a layout-aware multi-agent process. In the layout-aware mode, it parses the prompt into attribute-rich object descriptors, ranks them by semantic salience, and groups objects with the same semantic priority level for joint generation. Guided by the Interpreter, the Planner adopts a divide-and-conquer strategy, incrementally proposing layouts for objects with the same semantic priority level while grounding decisions in the evolving visual context of the canvas. The Checker introduces an explicit error-correction mechanism by validating spatial consistency and attribute alignment, and refining layouts before they are rendered. Finally, the Painter synthesizes the image step by step, incorporating newly planned objects into the canvas to provide richer context for subsequent iterations. Together, these agents address three key challenges: reducing layout complexity, grounding planning in visual context, and enabling explicit error correction. Extensive experiments on benchmarks GenEval and DPG-Bench demonstrate that coDrawAgents substantially improves text-image alignment, spatial accuracy, and attribute binding compared to existing methods.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 65 of its 71 references that are in the map. First posted on arXiv 13 Mar 2026.
Builds on
65 of 71 references.
References · 65
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2021Zero-Shot Text-to-Image Generationcited by 4,288
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,431
- 2025Qwen-Image Technical Reportcited by 1,044
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 972
38 more
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2024Emu3: Next-Token Prediction is All You Needcited by 781
- 2023Multimodal Chain-of-Thought Reasoning in Language Modelscited by 752
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2021CogView: Mastering Text-to-Image Generation via Transformerscited by 694
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 624
- 2023Ferret: Refer and Ground Anything Anywhere at Any Granularitycited by 509
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 475
- 2024Janus: Decoupling Visual Encoding for Unified Multimodal Understanding and Generationcited by 457
- 2025BLIP3-o: A Family of Fully Open Unified Multimodal Models-Architecture, Training and Datasetcited by 376
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 329
- 2024Hunyuan-DiT: A Powerful Multi-Resolution Diffusion Transformer with Fine-Grained Chinese Understandingcited by 298
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
- 2025OmniGen2: Towards Instruction-Aligned Multimodal Generationcited by 253
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
- 2024TokenFlow: Unified Image Tokenizer for Multimodal Understanding and Generationcited by 202
- 2025Seedream 3.0 Technical Reportcited by 154
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
- 2022Neural Wavelet-domain Diffusion for 3D Shape Generationcited by 132
- 2023Self-correcting LLM-controlled Diffusion Modelscited by 113
- 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
- 2023LayoutLLM-T2I: Eliciting Layout Guidance from LLM for Text-to-Image Generationcited by 92
- 2020Improving Image Captioning with Better Use of Captionscited by 84
- 2024Be Yourself: Bounded Attention for Multi-Subject Text-to-Image Generationcited by 69
- 2023DreamSync: Aligning Text-to-Image Generation with Image Understanding Feedbackcited by 58
- 2023LLM Blueprint: Enabling Text-to-Image Generation with Complex and Detailed Promptscited by 54
- 2024HiCo: Hierarchical Controllable Diffusion Model for Layout-to-image Generationcited by 41
- 20243DIS: Depth-Driven Decoupled Instance Synthesis for Text-to-Image Generationcited by 37
- 2024Parrot: Pareto-optimal Multi-Reward Reinforcement Learning Framework for Text-to-Image Generationcited by 36
- 2025T2I-Copilot: A Training-Free Multi-Agent Text-to-Image System for Enhanced Prompt Interpretation and Interactive Generationcited by 33
- 2023SSMG: Spatial-Semantic Map Guided Diffusion Model for Free-form Layout-to-Image Generationcited by 29
- 2024Proactive Agents for Multi-Turn Text-to-Image Generation Under Uncertaintycited by 25
- 2025MCCD: Multi-Agent Collaboration-based Compositional Diffusion for Complex Text-to-Image Generationcited by 23
- 20253DIS-FLUX: simple and efficient multi-instance generation with DiT renderingcited by 21
50 most cited of 65 All 65 (JSON)
Built on by
Citing papers per year: 2026: 7.
7 papers.
- 2026NEWTON: Agentic Planning for Physically Grounded Video Generationcited by 12
- 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learningcited by 2
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026CNS-Edit++: Category-Agnostic 3D Editing with Coupled Neural Shape Representationcited by 0
- 2026Panoptic Scene Program Diffusion Transformercited by 0
- 2026InfoAgent: Traceable Generation and Repair of Evidence-Grounded Infographicscited by 0
- 2026Look Back to Move Forward: Learning to Revisit for Agentic Compositional Image Generationcited by 0
- 2026Look Back to Move Forward: Learning to Revisit for Agentic Compositional Image Generation12 Oct 2026
- 2026InfoAgent: Traceable Generation and Repair of Evidence-Grounded Infographics30 Sep 2026
- 2026Panoptic Scene Program Diffusion Transformer24 Sep 2026
- 2026OmniHarness: Harnessing Generalizable Visual Generation via Symbolic Policy Learning13 Sep 2026
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026CNS-Edit++: Category-Agnostic 3D Editing with Coupled Neural Shape Representation18 Jul 2026
- 2026NEWTON: Agentic Planning for Physically Grounded Video Generation18 May 2026