CAL-RAG: Retrieval-Augmented Multi-Agent Generation for Content-Aware Layout Design
On the map: Retrieval-augmented generation → Multimodal RAG
also in 1 more
Abstract (arXiv)
Automated content-aware layout generation -- the task of arranging visual elements such as text, logos, and underlays on a background canvas -- remains a fundamental yet under-explored problem in intelligent design systems. While recent advances in deep generative models and large language models (LLMs) have shown promise in structured content generation, most existing approaches lack grounding in contextual design exemplars and fall short in handling semantic alignment and visual coherence. In this work we introduce CAL-RAG, a retrieval-augmented, agentic framework for content-aware layout generation that integrates multimodal retrieval, large language models, and collaborative agentic reasoning. Our system retrieves relevant layout examples from a structured knowledge base and invokes an LLM-based layout recommender to propose structured element placements. A vision-language grader agent evaluates the layout with visual metrics, and a feedback agent provides targeted refinements, enabling iterative improvement. We implement our framework using LangGraph and evaluate it on the PKU PosterLayout dataset, a benchmark rich in semantic and structural variability. CAL-RAG achieves state-of-the-art performance across multiple layout metrics -- including underlay effectiveness, element alignment, and overlap -- substantially outperforming strong baselines such as LayoutPrompter. These results demonstrate that combining retrieval augmentation with agentic multi-step reasoning yields a scalable, interpretable, and high-fidelity solution for automated layout generation.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 12 of its 18 references that are in the map. First posted on arXiv 27 Jun 2025.
Builds on
12 of 18 references.
Closest ancestors · 1
Same direction, newest first
Other references · 11
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
- 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 131
- 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
- 2021Variational Transformer Networks for Layout Generationcited by 88
- 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
- 2023LayoutDM: Transformer-based Diffusion Model for Layout Generationcited by 57
- 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 41
- 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correctioncited by 15
Built on by
Citing papers per year: 2025: 4; 2026: 3.
7 papers.
- 2025The Future is Agentic: Definitions, Perspectives, and Open Challenges of Multi-Agent Recommender Systemscited by 14
- 2026LLMs as Orchestrators: Constraint-Compliant Multi-Agent Optimization for Recommendation Systemscited by 5
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflowcited by 2
- 2025LLMs as Layout Designers: Enhanced Spatial Reasoning for Content-Aware Layout Generationcited by 1
- 2026From Pixels to Policies: Reinforcing Spatial Reasoning in Language Models for Content-Aware Layout Designcited by 1
- 2025MetaSynth: Multi-Agent Metadata Generation from Implicit Feedback in Black-Box Systemscited by 0
- 2025APD-Agents: A Large Language Model-Driven Multi-Agents Collaborative Framework for Automated Page Designcited by 0
- 2026PSDesigner: Automated Graphic Design with a Human-Like Creative Workflow26 Mar 2026
- 2026From Pixels to Policies: Reinforcing Spatial Reasoning in Language Models for Content-Aware Layout Design14 Feb 2026
- 2026LLMs as Orchestrators: Constraint-Compliant Multi-Agent Optimization for Recommendation Systems27 Jan 2026
- 2025APD-Agents: A Large Language Model-Driven Multi-Agents Collaborative Framework for Automated Page Design18 Nov 2025
- 2025MetaSynth: Multi-Agent Metadata Generation from Implicit Feedback in Black-Box Systems1 Oct 2025
- 2025LLMs as Layout Designers: Enhanced Spatial Reasoning for Content-Aware Layout Generation21 Sep 2025
- 2025The Future is Agentic: Definitions, Perspectives, and Open Challenges of Multi-Agent Recommender Systems2 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Models
- 2025PosterGen: Aesthetic-Aware Multi-Modal Paper-to-Poster Generation via Multi-Agent LLMs
- 2025LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generation
- 2025GraphicBench: A Planning Benchmark for Graphic Design with Language Agents
- 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLM
- 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Models
- 2026Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models
- 2026Intelligent Co-Design: An Interactive LLM Framework for Interior Spatial Design via Multi-Modal Agents