Forms of LLM-Integrated Applications from LLM-Chats to Autonomous AI Agent System
New in Retrieval-augmented generation; no direction yet. Retrieval-augmented generation
Abstract (arXiv)
Large language models (LLMs) are increasingly embedded as components in software systems, marketed under labels such as chatbot, copilot, retrieval-augmented generation, workflow, coding agent and AI agent. Whether these labels denote genuine architectural forms or serve as branding has not been assessed systematically. In the sources surveyed, labels do carry architectural content, most clearly in vendor usage: copilot denotes a router-worker architecture operating a host application under step-by-step user confirmation, while the more recent shift to the label agent coincides with AI-planned multi-step execution of which the user sees only the outcome. The coding agents of four major providers share one architecture, a reason-and-act loop delegating to subagents. This survey describes seven recurring forms---LLM chats, custom agents, retrieval-augmented generation (RAG), AI-enhanced workflows, copilots, coding agents, and, in part, agentic RAG---in a common vocabulary of agents and tools. Each is characterized along four structural dimensions (agentic RAG only partially): the architectural pattern, the control of execution and the point of user intervention, the number of agent calls per task, and tool use. An illustrative corpus of 22 systems from research publications and vendor documentation grounds the descriptions and shows where they reach their limit.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 9 of its 68 references that are in the map. First posted on arXiv 8 Oct 2026.
Builds on
9 of 68 references.
References · 9
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2025Multi-Agent Collaboration Mechanisms: A Survey of LLMscited by 431
- 2025Agentic Retrieval-Augmented Generation: A Survey on Agentic RAGcited by 249
- 2024The Landscape of Emerging AI Agent Architectures for Reasoning, Planning, and Tool Calling: A Surveycited by 168
- 2024A Survey on LLM-based Multi-Agent System: Recent Advances and New Frontiers in Applicationcited by 55
- 2025Fully Autonomous AI Agents Should Not be Developedcited by 45
- 2024Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applicationscited by 17
- 2025Keyword search is all you need: Achieving RAG-Level Performance without vector databases using agentic tool usecited by 10
- 2024GPTs Window Shopping: An analysis of the Landscape of Custom ChatGPT Modelscited by 4
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026LLM-Based Multi-Agent Systems for Code Generation: A Multi-Vocal Literature Review
- 2024ChainBuddy: An AI Agent System for Generating LLM Pipelines
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Future
- 2026LLM-Based Agents for Software and Systems Security: Approaches, Applications, and Assessment
- 2024Themes of Building LLM-based Applications for Production: A Practitioner's View ↗
- 2025Agent-S: LLM Agentic workflow to automate Standard Operating Procedures
- 2026When Agents Implement Systems: A Case Study in Defects, Detection, and Evaluation Rigor
- 2025LLM-Agent-Controller: A Universal Multi-Agent Large Language Model System as a Control Engineer