LLM Based Multi-Agent Generation of Semi-structured Documents from Semantic Templates in the Public Administration Domain
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
In the last years' digitalization process, the creation and management of documents in various domains, particularly in Public Administration (PA), have become increasingly complex and diverse. This complexity arises from the need to handle a wide range of document types, often characterized by semi-structured forms. Semi-structured documents present a fixed set of data without a fixed format. As a consequence, a template-based solution cannot be used, as understanding a document requires the extraction of the data structure. The recent introduction of Large Language Models (LLMs) has enabled the creation of customized text output satisfying user requests. In this work, we propose a novel approach that combines the LLMs with prompt engineering and multi-agent systems for generating new documents compliant with a desired structure. The main contribution of this work concerns replacing the commonly used manual prompting with a task description generated by semantic retrieval from an LLM. The potential of this approach is demonstrated through a series of experiments and case studies, showcasing its effectiveness in real-world PA scenarios.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 11 of its 16 references that are in the map. First posted on arXiv 21 Feb 2024.
Builds on
11 of 16 references.
References · 11
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 2023Benchmarking Large Language Models in Retrieval-Augmented Generationcited by 307
- 2022TabLLM: Few-shot Classification of Tabular Data with Large Language Modelscited by 273
- 2024MultiHop-RAG: Benchmarking Retrieval-Augmented Generation for Multi-Hop Queriescited by 253
- 2021Pretrained Language Models for Text Generation: A Surveycited by 95
- 2023Guiding Large Language Models via Directional Stimulus Promptingcited by 94
- 2023Principled Instructions Are All You Need for Questioning LLaMA-1/2, GPT-3.5/4cited by 48
- 2024LLM Harmony: Multi-Agent Communication for Problem Solvingcited by 34
- 2023Embedding-based Retrieval with LLM for Effective Agriculture Information Extracting from Unstructured Datacited by 16
Built on by
Citing papers per year: 2024: 4; 2025: 4; 2026: 1.
9 papers.
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 85
- 2025LegalWiz: A Multi-Agent Generation Framework for Contradiction Detection in Legal Documentscited by 7
- 2024Multi-Agent Planning Using Visual Language Modelscited by 6
- 2025Turning Conversations into Workflows: A Framework to Extract and Evaluate Dialog Workflows for Service AI Agentscited by 5
- 2024EMPOWER: Embodied Multi-role Open-vocabulary Planning with Online Grounding and Executioncited by 3
- 2026Agent Benchmarks Fail Public Sector Requirementscited by 2
- 2024A Large Language Model-based Framework for Semi-Structured Tender Document Retrieval-Augmented Generationcited by 1
- 2025MATRIX: Multimodal Agent Tuning for Robust Tool-Use Reasoningcited by 1
- 2025Theme-Explanation Structure for Table Summarization using Large Language Models: A Case Study on Korean Tabular Datacited by 0
- 2026Agent Benchmarks Fail Public Sector Requirements28 Jan 2026
- 2025MATRIX: Multimodal Agent Tuning for Robust Tool-Use Reasoning9 Oct 2025
- 2025LegalWiz: A Multi-Agent Generation Framework for Contradiction Detection in Legal Documents3 Oct 2025
- 2025Turning Conversations into Workflows: A Framework to Extract and Evaluate Dialog Workflows for Service AI Agents24 Feb 2025
- 2025Theme-Explanation Structure for Table Summarization using Large Language Models: A Case Study on Korean Tabular Data17 Jan 2025
- 2024A Large Language Model-based Framework for Semi-Structured Tender Document Retrieval-Augmented Generation4 Oct 2024
- 2024EMPOWER: Embodied Multi-role Open-vocabulary Planning with Online Grounding and Execution30 Aug 2024
- 2024Multi-Agent Planning Using Visual Language Models10 Aug 2024
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future5 Aug 2024
Similar, not cited
Close in wording, no citation either way
- 2026LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Review
- 2025Document Intelligence in the Era of Large Language Models: A Survey
- 2025LLM/Agent-as-Data-Analyst: A Survey
- 2025Large Language Models for Agent-Based Modelling: Current and possible uses across the modelling cycle
- 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Application
- 2025Agent-Enhanced Large Language Models for Researching Political Institutions
- 2026LLM Agents Factory: Retrieval of Domain-Specific LLM Agents
- 2025LLM-Based Data Science Agents: A Survey of Capabilities, Challenges, and Future Directions