mlsanityData to 14 Oct 2026

LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generation

arXiv 2504.10829 ↗First posted 15 Apr 2025cs.CVcited by 7

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Conditional layout generation aims to automatically generate visually appealing and semantically coherent layouts from user-defined constraints. While recent methods based on generative models have shown promising results, they typically require substantial amounts of training data or extensive fine-tuning, limiting their versatility and practical applicability. Alternatively, some training-free approaches leveraging in-context learning with Large Language Models (LLMs) have emerged, but they often suffer from limited reasoning capabilities and overly simplistic ranking mechanisms, which restrict their ability to generate consistently high-quality layouts. To this end, we propose LayoutCoT, a novel approach that leverages the reasoning capabilities of LLMs through a combination of Retrieval-Augmented Generation (RAG) and Chain-of-Thought (CoT) techniques. Specifically, LayoutCoT transforms layout representations into a standardized serialized format suitable for processing by LLMs. A Layout-aware RAG is used to facilitate effective retrieval and generate a coarse layout by LLMs. This preliminary layout, together with the selected exemplars, is then fed into a specially designed CoT reasoning module for iterative refinement, significantly enhancing both semantic coherence and visual quality. We conduct extensive experiments on five public datasets spanning three conditional layout generation tasks. Experimental results demonstrate that LayoutCoT achieves state-of-the-art performance without requiring training or fine-tuning. Notably, our CoT reasoning module enables standard LLMs, even those without explicit deep reasoning abilities, to outperform specialized deep-reasoning models such as deepseek-R1, highlighting the potential of our approach in unleashing the deep reasoning capabilities of LLMs for layout generation tasks.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 56 references that are in the map. First posted on arXiv 15 Apr 2025.

Builds on

40 of 56 references.

References · 40

  1. 2017Attention Is All You Needcited by 60,361
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  7. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  8. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  9. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  10. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  11. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  12. 2023Code Llama: Open Foundation Models for Codecited by 2,139
28 more
  1. 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
  2. 2019PubLayNet: largest dataset ever for document layout analysiscited by 351
  3. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
  4. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
  5. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
  6. 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
  7. 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 143
  8. 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 131
  9. 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 123
  10. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
  11. 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
  12. 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
  13. 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
  14. 2020Attribute-conditioned Layout GAN for Automatic Graphic Designcited by 68
  15. 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 61
  16. 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
  17. 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 48
  18. 2023WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semanticscited by 47
  19. 2025Deconstructing Long Chain-of-Thought: A Structured Reasoning Optimization Framework for Long CoT Distillationcited by 43
  20. 2023Unifying Layout Generation with a Decoupled Diffusion Modelcited by 41
  21. 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 36
  22. 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 35
  23. 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 35
  24. 2023LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Modelscited by 19
  25. 2023A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptionscited by 15
  26. 2024LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generationcited by 10
  27. 2021Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Modelscited by 8
  28. 2024Invar-RAG: Invariant LLM-aligned Retrieval for Better Generationcited by 3

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 3.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Models
  2. 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correction
  3. 2025CAL-RAG: Retrieval-Augmented Multi-Agent Generation for Content-Aware Layout Design
  4. 2026DocCogito: Aligning Layout Cognition and Step-Level Grounded Reasoning for Document Understanding
  5. 2025Smaller But Better: Unifying Layout Generation with Smaller Large Language Models
  6. 2025LayoutRAG: Retrieval-Augmented Model for Content-agnostic Conditional Layout Generation
  7. 2026SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs
  8. 2024DivCon: Divide and Conquer for Complex Numerical and Spatial Reasoning in Text-to-Image Generation