LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generation
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Conditional layout generation aims to automatically generate visually appealing and semantically coherent layouts from user-defined constraints. While recent methods based on generative models have shown promising results, they typically require substantial amounts of training data or extensive fine-tuning, limiting their versatility and practical applicability. Alternatively, some training-free approaches leveraging in-context learning with Large Language Models (LLMs) have emerged, but they often suffer from limited reasoning capabilities and overly simplistic ranking mechanisms, which restrict their ability to generate consistently high-quality layouts. To this end, we propose LayoutCoT, a novel approach that leverages the reasoning capabilities of LLMs through a combination of Retrieval-Augmented Generation (RAG) and Chain-of-Thought (CoT) techniques. Specifically, LayoutCoT transforms layout representations into a standardized serialized format suitable for processing by LLMs. A Layout-aware RAG is used to facilitate effective retrieval and generate a coarse layout by LLMs. This preliminary layout, together with the selected exemplars, is then fed into a specially designed CoT reasoning module for iterative refinement, significantly enhancing both semantic coherence and visual quality. We conduct extensive experiments on five public datasets spanning three conditional layout generation tasks. Experimental results demonstrate that LayoutCoT achieves state-of-the-art performance without requiring training or fine-tuning. Notably, our CoT reasoning module enables standard LLMs, even those without explicit deep reasoning abilities, to outperform specialized deep-reasoning models such as deepseek-R1, highlighting the potential of our approach in unleashing the deep reasoning capabilities of LLMs for layout generation tasks.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 40 of its 56 references that are in the map. First posted on arXiv 15 Apr 2025.
Builds on
40 of 56 references.
References · 40
- 2017Attention Is All You Needcited by 60,361
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023GPT-4 Technical Reportcited by 18,396
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2021Evaluating Large Language Models Trained on Codecited by 8,320
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2023Code Llama: Open Foundation Models for Codecited by 2,139
28 more
- 2025Towards Reasoning Era: A Survey of Long Chain-of-Thought for Reasoning Large Language Modelscited by 384
- 2019PubLayNet: largest dataset ever for document layout analysiscited by 351
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 337
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
- 2022Re3: Generating Longer Stories With Recursive Reprompting and Revisioncited by 193
- 2023LayoutDM: Discrete Diffusion Model for Controllable Layout Generationcited by 143
- 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 131
- 2020LayoutTransformer: Layout Generation and Completion with Self-attentioncited by 123
- 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
- 2019Neural Design Network: Graphic Layout Generation with Constraintscited by 83
- 2021Constrained Graphic Layout Generation via Latent Optimizationcited by 83
- 2021BLT: Bidirectional Layout Transformer for Controllable Layout Generationcited by 69
- 2020Attribute-conditioned Layout GAN for Automatic Graphic Designcited by 68
- 2023PosterLayout: A New Benchmark and Approach for Content-aware Visual-Textual Presentation Layoutcited by 61
- 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
- 2023LayoutPrompter: Awaken the Design Ability of Large Language Modelscited by 48
- 2023WebUI: A Dataset for Enhancing Visual UI Understanding with Web Semanticscited by 47
- 2025Deconstructing Long Chain-of-Thought: A Structured Reasoning Optimization Framework for Long CoT Distillationcited by 43
- 2023Unifying Layout Generation with a Decoupled Diffusion Modelcited by 41
- 2025A Survey on Knowledge-Oriented Retrieval-Augmented Generationcited by 36
- 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generationcited by 35
- 2024PosterLlama: Bridging Design Ability of Langauge Model to Contents-Aware Layout Generationcited by 35
- 2023LayoutNUWA: Revealing the Hidden Layout Expertise of Large Language Modelscited by 19
- 2023A Parse-Then-Place Approach for Generating Graphic Layouts from Textual Descriptionscited by 15
- 2024LTSim: Layout Transportation-based Similarity Measure for Evaluating Layout Generationcited by 10
- 2021Creating User Interface Mock-ups from High-Level Text Descriptions with Deep-Learning Modelscited by 8
- 2024Invar-RAG: Invariant LLM-aligned Retrieval for Better Generationcited by 3
Built on by
Citing papers per year: 2025: 4; 2026: 3.
7 papers.
- 2025LLM/Agent-as-Data-Analyst: A Surveycited by 16
- 2026APEX: Academic Poster Editing Agentic Expertcited by 6
- 2025PositionIC: Unified Position and Identity Consistency for Image Customizationcited by 4
- 2025OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learningcited by 2
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflowcited by 2
- 2025SheetDesigner: MLLM-Powered Spreadsheet Layout Generation with Rule-Based and Vision-Based Reflectioncited by 1
- 2026PLAYGROUND: Progressive Layout Generation with Render-Grounded Planningcited by 0
- 2026PLAYGROUND: Progressive Layout Generation with Render-Grounded Planning13 Oct 2026
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow26 Mar 2026
- 2026APEX: Academic Poster Editing Agentic Expert8 Jan 2026
- 2025OmniDocLayout: Towards Diverse Document Layout Generation via Coarse-to-Fine LLM Learning30 Oct 2025
- 2025LLM/Agent-as-Data-Analyst: A Survey28 Sep 2025
- 2025SheetDesigner: MLLM-Powered Spreadsheet Layout Generation with Rule-Based and Vision-Based Reflection9 Sep 2025
- 2025PositionIC: Unified Position and Identity Consistency for Image Customization18 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Models
- 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correction
- 2025CAL-RAG: Retrieval-Augmented Multi-Agent Generation for Content-Aware Layout Design
- 2026DocCogito: Aligning Layout Cognition and Step-Level Grounded Reasoning for Document Understanding
- 2025Smaller But Better: Unifying Layout Generation with Smaller Large Language Models
- 2025LayoutRAG: Retrieval-Augmented Model for Content-agnostic Conditional Layout Generation
- 2026SG-Layout: Structured Scene Graph-Guided Layout Generation with LLMs
- 2024DivCon: Divide and Conquer for Complex Numerical and Spatial Reasoning in Text-to-Image Generation