Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systems
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
Modern networked control systems (NCSs), cyber-physical systems (CPSs), and complex multi-agent network systems (CNSs) increasingly rely on large language models (LLMs) for high-level decision-making. However, the slow, stochastic nature of LLMs directly conflicts with the strict stability and safety guarantees required by these physical systems. This survey presents a unified analysis of how LLMs can be admitted into the control loop of NCS, CPS, and CNS without compromising closed-loop guarantees. We organize this around a core principle: the LLM operates as a slow supervisor adjusting high-level goals and constraints, while a fast, certified inner loop maintains physical stability. Under this framework, LLM integration maps directly to classical networked control challenges, where inference latency acts as delay, API failures as packet dropouts, tokenization as quantization, and hallucinations as bounded disturbances. We assess current developments across all these three domains, highlighting that rising model capabilities are frequently accompanied by a drop in formal safety assurances. Finally, we propose concrete future research directions, identifying the widespread lack of formal stability proofs as the field's central open problem.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 116 of its 164 references that are in the map. First posted on arXiv 15 Sep 2026.
Builds on
116 of 164 references.
Closest ancestors · 6
Same direction, newest first
- 2025LLM-Agent-Controller: A Universal Multi-Agent Large Language Model System as a Control Engineer26 May
- 2024ControlAgent: Automating Control System Design via Novel Integration of LLM Agents and Domain Expertise17 Oct
- 2023Controlling Large Language Model-based Agents for Large-Scale Decision-Making: An Actor-Critic Approach23 Nov
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
- 2023Building Cooperative Embodied Agents Modularly with Large Language Models5 Jul
- 2023Towards autonomous system: flexible modular production system enhanced with large language model agents28 Apr
Other references · 110
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023A Survey of Large Language Modelscited by 2,576
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
38 more
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 744
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
- 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
- 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
- 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
- 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 429
- 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
- 2019Control Barrier Functions: Theory and Applicationscited by 372
- 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 371
- 2017Safe Model-based Reinforcement Learning with Stability Guaranteescited by 366
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 2023GPT-Driver: Learning to Drive with GPTcited by 347
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
- 2023Language to Rewards for Robotic Skill Synthesiscited by 312
- 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 308
- 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 305
- 2023Tool Learning with Foundation Modelscited by 302
- 2018A Lyapunov-based Approach to Safe Reinforcement Learningcited by 297
- 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 294
- 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
- 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 224
- 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agentscited by 223
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 216
- 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 207
- 2024A Survey on Efficient Inference for Large Language Modelscited by 205
- 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 190
- 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 172
- 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 165
- 2017A General Safety Framework for Learning-Based Control in Uncertain Robotic Systemscited by 163
50 most cited of 110 All 110 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026NetConfArena: An Executable Benchmark for LLM Agents in Closed-Loop Network Configuration
- 2026NetAgentBench: A State-Centric Benchmark for Evaluating Agentic Network Configuration
- 2026NRT-Bench: Benchmarking Multi-Turn Red-Teaming of LLM Operator Agents in Safety-Critical Control Rooms
- 2025Benchmark for Planning and Control with Large Language Model Agents: Blocksworld with Model Context Protocol
- 2026Benchmarking and Reasoning Distillation of Large Language Models for Feedback Controller Design in Complex Dynamical Systems
- 2026From Inference Engine to Inference Control Plane: Connecting vLLM, llm-d, and the Evolution of Efficient Distributed LLM Serving
- 2026Predictive Maps of Multi-Agent Reasoning: A Successor-Representation Spectrum for LLM Communication Topologies
- 2024Practical Considerations for Agentic LLM Systems