mlsanityData to 14 Oct 2026

CAL-RAG: Retrieval-Augmented Multi-Agent Generation for Content-Aware Layout Design

arXiv 2506.21934 ↗First posted 27 Jun 2025cs.IR cs.CVcited by 7

On the map: Retrieval-augmented generation → Multimodal RAG

also in 1 more
Abstract (arXiv)

Automated content-aware layout generation -- the task of arranging visual elements such as text, logos, and underlays on a background canvas -- remains a fundamental yet under-explored problem in intelligent design systems. While recent advances in deep generative models and large language models (LLMs) have shown promise in structured content generation, most existing approaches lack grounding in contextual design exemplars and fall short in handling semantic alignment and visual coherence. In this work we introduce CAL-RAG, a retrieval-augmented, agentic framework for content-aware layout generation that integrates multimodal retrieval, large language models, and collaborative agentic reasoning. Our system retrieves relevant layout examples from a structured knowledge base and invokes an LLM-based layout recommender to propose structured element placements. A vision-language grader agent evaluates the layout with visual metrics, and a feedback agent provides targeted refinements, enabling iterative improvement. We implement our framework using LangGraph and evaluate it on the PKU PosterLayout dataset, a benchmark rich in semantic and structural variability. CAL-RAG achieves state-of-the-art performance across multiple layout metrics -- including underlay effectiveness, element alignment, and overlap -- substantially outperforming strong baselines such as LayoutPrompter. These results demonstrate that combining retrieval augmentation with agentic multi-step reasoning yields a scalable, interpretable, and high-fidelity solution for automated layout generation.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Multimodal RAG, one of 15 directions in Retrieval-augmented generation. Builds on 12 of its 18 references that are in the map. First posted on arXiv 27 Jun 2025.

Builds on

12 of 18 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023Retrieval-Augmented Layout Transformer for Content-Aware Layout Generation22 Nov

Other references · 11

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  3. 2023CRITIC: Large Language Models Can Self-Correct with Tool-Interactive Critiquingcited by 783
  4. 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
  5. 2019LayoutGAN: Generating Graphic Layouts with Wireframe Discriminatorscited by 131
  6. 2019LayoutVAE: Stochastic Scene Layout Generation From a Label Setcited by 119
  7. 2021Variational Transformer Networks for Layout Generationcited by 88
  8. 2022Composition-aware Graphic Layout GAN for Visual-textual Presentation Designscited by 59
  9. 2023LayoutDM: Transformer-based Diffusion Model for Layout Generationcited by 57
  10. 2024PosterLLaVa: Constructing a Unified Multi-modal Layout Generator with LLMcited by 41
  11. 2024VASCAR: Content-Aware Layout Generation via Visual-Aware Self-Correctioncited by 15

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 3.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025ReLayout: Integrating Relation Reasoning for Content-aware Layout Generation with Multi-modal Large Language Models
  2. 2025PosterGen: Aesthetic-Aware Multi-Modal Paper-to-Poster Generation via Multi-Agent LLMs
  3. 2025LayoutCoT: Unleashing the Deep Reasoning Potential of Large Language Models for Layout Generation
  4. 2025GraphicBench: A Planning Benchmark for Graphic Design with Language Agents
  5. 2024Chat2Layout: Interactive 3D Furniture Layout with a Multimodal LLM
  6. 2025AesthetiQ: Enhancing Graphic Layout Design via Aesthetic-Aware Preference Alignment of Multi-modal Large Language Models
  7. 2026Beyond Atomic Layouts: Compositional Design Understanding with Vision-Language Models
  8. 2026Intelligent Co-Design: An Interactive LLM Framework for Interior Spatial Design via Multi-Modal Agents