Think, Plan, Paint: Layout-Aware Reasoning for Controllable Image Generation in Unified Models
On the map: LLM reasoning → Multimodal reasoning
Abstract (arXiv)
Unified Multimodal Large Language Models (MLLMs) offer a promising paradigm for unifying visual understanding and generation, yet they still struggle to follow complex spatial instructions and logical constraints in controllable image generation. To address this gap, we present ATLAS, a unified framework that equips MLLMs with a human-like "Think, Plan, and Paint" paradigm. We adopt layout as the shared representation that connects the three stages, enabling the model to reason about spatial requirements, plan explicit object arrangements, and render the final image. We further improve plan-to-image fidelity with reinforcement-learning-based layout alignment. We instantiate ATLAS at 7B and 80B scales, achieving state-of-the-art performance among MLLMs on image generation benchmarks and an average 65.31% improvement over existing layout-based unified MLLMs. On spatially related tasks, ATLAS obtains an average 23.06% gain over the base models. Through the same layout interface, ATLAS also supports instruction-guided editing and multimodal grounding. We further introduce ATLAS-Reasoning, a benchmark for evaluating generation under complex spatial instructions.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 39 of its 47 references that are in the map. First posted on arXiv 17 Jul 2026.
Builds on
39 of 47 references.
Closest ancestors · 2
Same direction, newest first
- 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning30 Oct
- 2025LayerCraft: Enhancing Text-to-Image Generation with CoT Reasoning and Layered Object Integration25 Mar
Other references · 37
- 2023Visual Instruction Tuningcited by 7,792
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2024GPT-4o System Cardcited by 4,467
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
- 2025Qwen3-VL Technical Reportcited by 2,534
25 more
- 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
- 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
- 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
- 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
- 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
- 2023Emu: Generative Pretraining in Multimodalitycited by 156
- 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
- 2024Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretrainingcited by 148
- 2025HunyuanImage 3.0 Technical Reportcited by 138
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 132
- 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 58
- 2023Visual Programming for Text-to-Image Generation and Evaluationcited by 53
- 2024Divide and Conquer: Language Models can Plan and Self-Correct for Compositional Text-to-Image Generationcited by 4
- 2024GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layoutscited by 3
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Spatial Chain-of-Thought: Bridging Understanding and Generation Models for Spatial Reasoning Generation
- 2025PlanGen: Towards Unified Layout Planning and Image Generation in Auto-Regressive Vision Language Models
- 2026SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoning
- 2026JoyAI-Image: Awaking Spatial Intelligence in Unified Multimodal Understanding and Generation
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning
- 20263D-Layout-R1: Structured Reasoning for Language-Instructed Spatial Editing
- 2026SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs
- 2025Thinking with Programming Vision: Towards a Unified View for Thinking with Images