mlsanityData to 14 Oct 2026

Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systems

arXiv 2609.16599 ↗First posted 15 Sep 2026eess.SY cs.AI cs.SYcited by 0

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Modern networked control systems (NCSs), cyber-physical systems (CPSs), and complex multi-agent network systems (CNSs) increasingly rely on large language models (LLMs) for high-level decision-making. However, the slow, stochastic nature of LLMs directly conflicts with the strict stability and safety guarantees required by these physical systems. This survey presents a unified analysis of how LLMs can be admitted into the control loop of NCS, CPS, and CNS without compromising closed-loop guarantees. We organize this around a core principle: the LLM operates as a slow supervisor adjusting high-level goals and constraints, while a fast, certified inner loop maintains physical stability. Under this framework, LLM integration maps directly to classical networked control challenges, where inference latency acts as delay, API failures as packet dropouts, tokenization as quantization, and hallucinations as bounded disturbances. We assess current developments across all these three domains, highlighting that rising model capabilities are frequently accompanied by a drop in formal safety assurances. Finally, we propose concrete future research directions, identifying the widespread lack of formal stability proofs as the field's central open problem.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 116 of its 164 references that are in the map. First posted on arXiv 15 Sep 2026.

Builds on

116 of 164 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025LLM-Agent-Controller: A Universal Multi-Agent Large Language Model System as a Control Engineer26 May
  2. 2024ControlAgent: Automating Control System Design via Novel Integration of LLM Agents and Domain Expertise17 Oct
  3. 2023Controlling Large Language Model-based Agents for Large-Scale Decision-Making: An Actor-Critic Approach23 Nov
  4. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Framework1 Aug
  5. 2023Building Cooperative Embodied Agents Modularly with Large Language Models5 Jul
  6. 2023Towards autonomous system: flexible modular production system enhanced with large language model agents28 Apr

Other references · 110

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  4. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  5. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  7. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  8. 2023A Survey of Large Language Modelscited by 2,576
  9. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  10. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  11. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  12. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
38 more
  1. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  2. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  3. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
  4. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  5. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,035
  6. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 916
  7. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
  8. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  9. 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 744
  10. 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 571
  11. 2023DriveLM: Driving with Graph Visual Question Answeringcited by 536
  12. 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
  13. 2024DriveVLM: The Convergence of Autonomous Driving and Large Vision-Language Modelscited by 490
  14. 2023DriveGPT4: Interpretable End-to-end Autonomous Driving via Large Language Modelcited by 461
  15. 2024AgentPoison: Red-teaming LLM Agents via Poisoning Memory or Knowledge Basescited by 429
  16. 2023A Survey on Large Language Model (LLM) Security and Privacy: The Good, the Bad, and the Uglycited by 387
  17. 2019Control Barrier Functions: Theory and Applicationscited by 372
  18. 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 371
  19. 2017Safe Model-based Reinforcement Learning with Stability Guaranteescited by 366
  20. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
  21. 2023GPT-Driver: Learning to Drive with GPTcited by 347
  22. 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 315
  23. 2023Language to Rewards for Robotic Skill Synthesiscited by 312
  24. 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 308
  25. 2023LMDrive: Closed-Loop End-to-End Driving with Large Language Modelscited by 305
  26. 2023Tool Learning with Foundation Modelscited by 302
  27. 2018A Lyapunov-based Approach to Safe Reinforcement Learningcited by 297
  28. 2023SayPlan: Grounding Large Language Models using 3D Scene Graphs for Scalable Robot Task Planningcited by 294
  29. 2023DriveMLM: Aligning Multi-Modal Large Language Models with Behavioral Planning States for Autonomous Drivingcited by 233
  30. 2023Text2Motion: From Natural Language Instructions to Feasible Planscited by 224
  31. 2025AgentSpec: Customizable Runtime Enforcement for Safe and Reliable LLM Agentscited by 223
  32. 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 216
  33. 2023DiLu: A Knowledge-Driven Approach to Autonomous Driving with Large Language Modelscited by 207
  34. 2024A Survey on Efficient Inference for Large Language Modelscited by 205
  35. 2023LanguageMPC: Large Language Models as Decision Makers for Autonomous Drivingcited by 190
  36. 2023RoCo: Dialectic Multi-Robot Collaboration with Large Language Modelscited by 172
  37. 2021BEHAVIOR: Benchmark for Everyday Household Activities in Virtual, Interactive, and Ecological Environmentscited by 165
  38. 2017A General Safety Framework for Learning-Based Control in Uncertain Robotic Systemscited by 163

50 most cited of 110 All 110 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026NetConfArena: An Executable Benchmark for LLM Agents in Closed-Loop Network Configuration
  2. 2026NetAgentBench: A State-Centric Benchmark for Evaluating Agentic Network Configuration
  3. 2026NRT-Bench: Benchmarking Multi-Turn Red-Teaming of LLM Operator Agents in Safety-Critical Control Rooms
  4. 2025Benchmark for Planning and Control with Large Language Model Agents: Blocksworld with Model Context Protocol
  5. 2026Benchmarking and Reasoning Distillation of Large Language Models for Feedback Controller Design in Complex Dynamical Systems
  6. 2026From Inference Engine to Inference Control Plane: Connecting vLLM, llm-d, and the Evolution of Efficient Distributed LLM Serving
  7. 2026Predictive Maps of Multi-Agent Reasoning: A Successor-Representation Spectrum for LLM Communication Topologies
  8. 2024Practical Considerations for Agentic LLM Systems