mlsanityData to 7 Oct 2026

Think, Plan, Paint: Layout-Aware Reasoning for Controllable Image Generation in Unified Models

arXiv 2607.16409 ↗First posted 17 Jul 2026cs.CV cs.AI cs.LGcited by 1

On the map: LLM reasoning → Multimodal reasoning

also in 1 more
Abstract (arXiv)

Unified Multimodal Large Language Models (MLLMs) offer a promising paradigm for unifying visual understanding and generation, yet they still struggle to follow complex spatial instructions and logical constraints in controllable image generation. To address this gap, we present ATLAS, a unified framework that equips MLLMs with a human-like "Think, Plan, and Paint" paradigm. We adopt layout as the shared representation that connects the three stages, enabling the model to reason about spatial requirements, plan explicit object arrangements, and render the final image. We further improve plan-to-image fidelity with reinforcement-learning-based layout alignment. We instantiate ATLAS at 7B and 80B scales, achieving state-of-the-art performance among MLLMs on image generation benchmarks and an average 65.31% improvement over existing layout-based unified MLLMs. On spatially related tasks, ATLAS obtains an average 23.06% gain over the base models. Through the same layout interface, ATLAS also supports instruction-guided editing and multimodal grounding. We further introduce ATLAS-Reasoning, a benchmark for evaluating generation under complex spatial instructions.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Multimodal reasoning, one of 17 directions in LLM reasoning. Builds on 39 of its 47 references that are in the map. First posted on arXiv 17 Jul 2026.

Builds on

39 of 47 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025ThinkMorph: Emergent Properties in Multimodal Interleaved Chain-of-Thought Reasoning30 Oct
  2. 2025LayerCraft: Enhancing Text-to-Image Generation with CoT Reasoning and Layered Object Integration25 Mar

Other references · 37

  1. 2023Visual Instruction Tuningcited by 7,792
  2. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  3. 2024GPT-4o System Cardcited by 4,467
  4. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
  6. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  7. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
  8. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  9. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,413
  10. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  11. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,591
  12. 2025Qwen3-VL Technical Reportcited by 2,534
25 more
  1. 2022Prompt-to-Prompt Image Editing with Cross Attention Controlcited by 2,409
  2. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,179
  3. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  4. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  5. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  6. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  7. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  8. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 718
  9. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 605
  10. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  11. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
  12. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 328
  13. 2023T2I-CompBench++: An Enhanced and Comprehensive Benchmark for Compositional Text-to-image Generationcited by 253
  14. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 242
  15. 2025ImgEdit: A Unified Image Editing Dataset and Benchmarkcited by 225
  16. 2023Guiding Instruction-based Image Editing via Multimodal Large Language Modelscited by 182
  17. 2023Emu: Generative Pretraining in Multimodalitycited by 156
  18. 2024Mixture-of-Transformers: A Sparse and Scalable Architecture for Multi-Modal Foundation Modelscited by 151
  19. 2024Lumina-mGPT: Illuminate Flexible Photorealistic Text-to-Image Generation with Multimodal Generative Pretrainingcited by 148
  20. 2025HunyuanImage 3.0 Technical Reportcited by 138
  21. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 132
  22. 2024CreatiLayout: Siamese Multimodal Diffusion Transformer for Creative Layout-to-Image Generationcited by 58
  23. 2023Visual Programming for Text-to-Image Generation and Evaluationcited by 53
  24. 2024Divide and Conquer: Language Models can Plan and Self-Correct for Compositional Text-to-Image Generationcited by 4
  25. 2024GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layoutscited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026Spatial Chain-of-Thought: Bridging Understanding and Generation Models for Spatial Reasoning Generation
  2. 2025PlanGen: Towards Unified Layout Planning and Image Generation in Auto-Regressive Vision Language Models
  3. 2026SpatialImaginer: Towards Adaptive Visual Imagination for Spatial Reasoning
  4. 2026JoyAI-Image: Awaking Spatial Intelligence in Unified Multimodal Understanding and Generation
  5. 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning
  6. 20263D-Layout-R1: Structured Reasoning for Language-Instructed Spatial Editing
  7. 2026SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs
  8. 2025Thinking with Programming Vision: Towards a Unified View for Thinking with Images