Towards autonomous system: flexible modular production system enhanced with large language model agents
On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks
Abstract (arXiv)
In this paper, we present a novel framework that combines large language models (LLMs), digital twins and industrial automation system to enable intelligent planning and control of production processes. We retrofit the automation system for a modular production facility and create executable control interfaces of fine-granular functionalities and coarse-granular skills. Low-level functionalities are executed by automation components, and high-level skills are performed by automation modules. Subsequently, a digital twin system is developed, registering these interfaces and containing additional descriptive information about the production system. Based on the retrofitted automation system and the created digital twins, LLM-agents are designed to interpret descriptive information in the digital twins and control the physical system through service interfaces. These LLM-agents serve as intelligent agents on different levels within an automation system, enabling autonomous planning and control of flexible production. Given a task instruction as input, the LLM-agents orchestrate a sequence of atomic functionalities and skills to accomplish the task. We demonstrate how our implemented prototype can handle un-predefined tasks, plan a production process, and execute the operations. This research highlights the potential of integrating LLMs into industrial automation systems in the context of smart factory for more agile, flexible, and adaptive production processes, while it also underscores the critical insights and limitations for future work. Demos at: https://github.com/YuchenXia/GPT4IndustrialAutomation
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 12 of its 24 references that are in the map. First posted on arXiv 28 Apr 2023.
Builds on
12 of 24 references.
References · 12
- 2017Attention Is All You Needcited by 59,932
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2021Finetuned Language Models Are Zero-Shot Learnerscited by 3,747
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
- 2020Making Pre-trained Language Models Better Few-shot Learnerscited by 1,255
- 2019Analyzing the Structure of Attention in a Transformer Language Modelcited by 241
- 2023Why think step by step? Reasoning emerges from the locality of experiencecited by 103
- 2021Enhancing an Intelligent Digital Twin with a Self-organized Reconfiguration Management based on Adaptive Process Modelscited by 3
- 2022An Agent-based Realisation for a continuous Model Adaption Approach in intelligent Digital Twinscited by 1
Built on by
Citing papers per year: 2023: 5; 2024: 12; 2025: 14; 2026: 7.
38 papers.
Sort:
By area:
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023Cognitive Architectures for Language Agentscited by 422
- 2023On Generative Agents in Recommendationcited by 88
- 2025MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflowcited by 71
- 2024Large Language Models for UAVs: Current State and Pathways to the Futurecited by 33
- 2025LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospectscited by 31
- 2023LLMind: Orchestrating AI and IoT with LLM for Complex Task Executioncited by 24
- 2024Autonomous Industrial Control using an Agentic Framework with Large Language Modelscited by 19
- 2024Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applicationscited by 17
- 2024LLM experiments with simulation: Large Language Model Multi-Agent System for Simulation Model Parametrization in Digital Twinscited by 16
- 2023Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agentscited by 13
- 2024An LLM-Based Digital Twin for Optimizing Human-in-the Loop Systemscited by 12
26 more
- 2024Control Industrial Automation System with Large Language Model Agentscited by 11
- 2025Leveraging LLM Agents and Digital Twins for Fault Handling in Process Plantscited by 9
- 2024Generation of Asset Administration Shell with Large Language Model Agents: Toward Semantic Interoperability in Digital Twins in the Context of Industry 4.0cited by 8
- 2025Autonomous Control Leveraging LLMs: An Agentic Framework for Next-Generation Industrial Automationcited by 8
- 2024Large Language Models as Minecraft Agentscited by 7
- 2024Incorporating Large Language Models into Production Systems for Enhanced Task Automation and Flexibilitycited by 5
- 2024A Taxonomy of Architecture Options for Foundation Model-based Agents: Analysis and Decision Modelcited by 4
- 2025An LLM-enabled Multi-Agent Autonomous Mechatronics Design Frameworkcited by 4
- 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Makingcited by 4
- 2025Chain-of-Trigger: An Agentic Backdoor that Paradoxically Enhances Agentic Robustnesscited by 4
- 2025Benchmark for Planning and Control with Large Language Model Agents: Blocksworld with Model Context Protocolcited by 3
- 2024Knowledge Sharing in Manufacturing using Large Language Models: User Evaluation and Model Benchmarkingcited by 2
- 2025Generative Machine Learning in Adaptive Control of Dynamic Manufacturing Processes: A Reviewcited by 2
- 2025Divide by Question, Conquer by Agent: SPLIT-RAG with Question-Driven Graph Partitioningcited by 2
- 2025Hyperbolic Large Language Modelscited by 2
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agentscited by 2
- 2024Collaborative AI in Sentiment Analysis: System Architecture, Data Prediction and Deployment Strategiescited by 1
- 2025Integrating Machine Learning into Belief-Desire-Intention Agents: Current Advances and Open Challengescited by 1
- 2026Design-to-Plan: A Large Language Model-Based Multi-Agent Framework for Manufacturing Process Planning from 3D CAD Models and 2D Engineering Drawingscited by 1
- 2025FurniMAS: Language-Guided Furniture Decoration using Multi-Agent Systemcited by 0
- 2026Towards an Intention Abstraction Layer for Autonomous Industrial Systemscited by 0
- 2026Safety-Gated Agentic Supervisory Control on a Coupled Distillation Benchmark: Regime Map, Auditable Gate, and Co-Design Findingscited by 0
- 2026Agentic AI for Safety-critical Multi-drone Systems: Challenges and Opportunitiescited by 0
- 2026LLM Agents Perform Controlled Experiments Using Simulation Modelscited by 0
- 2026Agentic AI-enabled Semantic Commissioning of a Cognitive Digital Twin for Reconfigurable Manufacturingcited by 0
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systemscited by 0
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systems15 Sep 2026
- 2026Agentic AI-enabled Semantic Commissioning of a Cognitive Digital Twin for Reconfigurable Manufacturing8 Sep 2026
- 2026Design-to-Plan: A Large Language Model-Based Multi-Agent Framework for Manufacturing Process Planning from 3D CAD Models and 2D Engineering Drawings25 Aug 2026
- 2026LLM Agents Perform Controlled Experiments Using Simulation Models22 Aug 2026
- 2026Agentic AI for Safety-critical Multi-drone Systems: Challenges and Opportunities19 Aug 2026
- 2026Safety-Gated Agentic Supervisory Control on a Coupled Distillation Benchmark: Regime Map, Auditable Gate, and Co-Design Findings30 Jul 2026
- 2026Towards an Intention Abstraction Layer for Autonomous Industrial Systems16 Jul 2026
- 2025Benchmark for Planning and Control with Large Language Model Agents: Blocksworld with Model Context Protocol3 Dec 2025
- 2025Integrating Machine Learning into Belief-Desire-Intention Agents: Current Advances and Open Challenges23 Oct 2025
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents20 Oct 2025
- 2025Chain-of-Trigger: An Agentic Backdoor that Paradoxically Enhances Agentic Robustness9 Oct 2025
- 2025Hyperbolic Large Language Models6 Sep 2025
26 more
- 2025FurniMAS: Language-Guided Furniture Decoration using Multi-Agent System7 Jul 2025
- 2025Autonomous Control Leveraging LLMs: An Agentic Framework for Next-Generation Industrial Automation3 Jul 2025
- 2025Divide by Question, Conquer by Agent: SPLIT-RAG with Question-Driven Graph Partitioning20 May 2025
- 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Making19 May 2025
- 2025Leveraging LLM Agents and Digital Twins for Fault Handling in Process Plants4 May 2025
- 2025Generative Machine Learning in Adaptive Control of Dynamic Manufacturing Processes: A Review30 Apr 2025
- 2025LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospects28 Apr 2025
- 2025An LLM-enabled Multi-Agent Autonomous Mechatronics Design Framework20 Apr 2025
- 2025MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflow21 Mar 2025
- 2024Autonomous Industrial Control using an Agentic Framework with Large Language Models8 Nov 2024
- 2024Collaborative AI in Sentiment Analysis: System Architecture, Data Prediction and Deployment Strategies17 Oct 2024
- 2024Control Industrial Automation System with Large Language Model Agents26 Sep 2024
- 2024A Taxonomy of Architecture Options for Foundation Model-based Agents: Analysis and Decision Model6 Aug 2024
- 2024Incorporating Large Language Models into Production Systems for Enhanced Task Automation and Flexibility11 Jul 2024
- 2024Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applications13 Jun 2024
- 2024LLM experiments with simulation: Large Language Model Multi-Agent System for Simulation Model Parametrization in Digital Twins28 May 2024
- 2024Large Language Models for UAVs: Current State and Pathways to the Future2 May 2024
- 2024Generation of Asset Administration Shell with Large Language Model Agents: Toward Semantic Interoperability in Digital Twins in the Context of Industry 4.025 Mar 2024
- 2024An LLM-Based Digital Twin for Optimizing Human-in-the Loop Systems25 Mar 2024
- 2024Large Language Models as Minecraft Agents13 Feb 2024
- 2024Knowledge Sharing in Manufacturing using Large Language Models: User Evaluation and Model Benchmarking10 Jan 2024
- 2023LLMind: Orchestrating AI and IoT with LLM for Complex Task Execution14 Dec 2023
- 2023Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agents22 Nov 2023
- 2023On Generative Agents in Recommendation16 Oct 2023
- 2023Cognitive Architectures for Language Agents5 Sep 2023
- 2023A Survey on Large Language Model based Autonomous Agents22 Aug 2023
- 2023A Survey on Large Language Model based Autonomous Agentscited by 2,203
- 2023Cognitive Architectures for Language Agentscited by 422
- 2023On Generative Agents in Recommendationcited by 88
- 2025LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospectscited by 31
- 2024Autonomous Industrial Control using an Agentic Framework with Large Language Modelscited by 19
- 2024LLM experiments with simulation: Large Language Model Multi-Agent System for Simulation Model Parametrization in Digital Twinscited by 16
- 2024Control Industrial Automation System with Large Language Model Agentscited by 11
- 2025Leveraging LLM Agents and Digital Twins for Fault Handling in Process Plantscited by 9
- 2024Generation of Asset Administration Shell with Large Language Model Agents: Toward Semantic Interoperability in Digital Twins in the Context of Industry 4.0cited by 8
- 2024Large Language Models as Minecraft Agentscited by 7
- 2024A Taxonomy of Architecture Options for Foundation Model-based Agents: Analysis and Decision Modelcited by 4
- 2025An LLM-enabled Multi-Agent Autonomous Mechatronics Design Frameworkcited by 4
12 most cited of 21 All 21 (JSON)
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systems15 Sep 2026
- 2026Agentic AI-enabled Semantic Commissioning of a Cognitive Digital Twin for Reconfigurable Manufacturing8 Sep 2026
- 2026Design-to-Plan: A Large Language Model-Based Multi-Agent Framework for Manufacturing Process Planning from 3D CAD Models and 2D Engineering Drawings25 Aug 2026
- 2026LLM Agents Perform Controlled Experiments Using Simulation Models22 Aug 2026
- 2026Agentic AI for Safety-critical Multi-drone Systems: Challenges and Opportunities19 Aug 2026
- 2025Benchmark for Planning and Control with Large Language Model Agents: Blocksworld with Model Context Protocol3 Dec 2025
- 2025Chain-of-Trigger: An Agentic Backdoor that Paradoxically Enhances Agentic Robustness9 Oct 2025
- 2025FurniMAS: Language-Guided Furniture Decoration using Multi-Agent System7 Jul 2025
- 2025Simulation Agent: A Framework for Integrating Simulation and Large Language Models for Enhanced Decision-Making19 May 2025
- 2025Leveraging LLM Agents and Digital Twins for Fault Handling in Process Plants4 May 2025
- 2025LLM-Powered GUI Agents in Phone Automation: Surveying Progress and Prospects28 Apr 2025
- 2025An LLM-enabled Multi-Agent Autonomous Mechatronics Design Framework20 Apr 2025
12 newest of 21 All 21 (JSON)
- 2025MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflowcited by 71
- 2023Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agentscited by 13
- 2025Autonomous Control Leveraging LLMs: An Agentic Framework for Next-Generation Industrial Automationcited by 8
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agentscited by 2
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents20 Oct 2025
- 2025Autonomous Control Leveraging LLMs: An Agentic Framework for Next-Generation Industrial Automation3 Jul 2025
- 2025MedAgent-Pro: Towards Evidence-based Multi-modal Medical Diagnosis via Reasoning Agentic Workflow21 Mar 2025
- 2023Towards Responsible Generative AI: A Reference Architecture for Designing Foundation Model based Agents22 Nov 2023
- 2024Large Language Models for UAVs: Current State and Pathways to the Futurecited by 33
- 2023LLMind: Orchestrating AI and IoT with LLM for Complex Task Executioncited by 24
- 2024Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applicationscited by 17
- 2024An LLM-Based Digital Twin for Optimizing Human-in-the Loop Systemscited by 12
- 2024Incorporating Large Language Models into Production Systems for Enhanced Task Automation and Flexibilitycited by 5
- 2024Knowledge Sharing in Manufacturing using Large Language Models: User Evaluation and Model Benchmarkingcited by 2
- 2025Generative Machine Learning in Adaptive Control of Dynamic Manufacturing Processes: A Reviewcited by 2
- 2025Hyperbolic Large Language Modelscited by 2
- 2024Collaborative AI in Sentiment Analysis: System Architecture, Data Prediction and Deployment Strategiescited by 1
- 2025Integrating Machine Learning into Belief-Desire-Intention Agents: Current Advances and Open Challengescited by 1
- 2026Towards an Intention Abstraction Layer for Autonomous Industrial Systemscited by 0
- 2026Safety-Gated Agentic Supervisory Control on a Coupled Distillation Benchmark: Regime Map, Auditable Gate, and Co-Design Findingscited by 0
- 2026Safety-Gated Agentic Supervisory Control on a Coupled Distillation Benchmark: Regime Map, Auditable Gate, and Co-Design Findings30 Jul 2026
- 2026Towards an Intention Abstraction Layer for Autonomous Industrial Systems16 Jul 2026
- 2025Integrating Machine Learning into Belief-Desire-Intention Agents: Current Advances and Open Challenges23 Oct 2025
- 2025Hyperbolic Large Language Models6 Sep 2025
- 2025Generative Machine Learning in Adaptive Control of Dynamic Manufacturing Processes: A Review30 Apr 2025
- 2024Collaborative AI in Sentiment Analysis: System Architecture, Data Prediction and Deployment Strategies17 Oct 2024
- 2024Incorporating Large Language Models into Production Systems for Enhanced Task Automation and Flexibility11 Jul 2024
- 2024Large Language Models as Software Components: A Taxonomy for LLM-Integrated Applications13 Jun 2024
- 2024Large Language Models for UAVs: Current State and Pathways to the Future2 May 2024
- 2024An LLM-Based Digital Twin for Optimizing Human-in-the Loop Systems25 Mar 2024
- 2024Knowledge Sharing in Manufacturing using Large Language Models: User Evaluation and Model Benchmarking10 Jan 2024
- 2023LLMind: Orchestrating AI and IoT with LLM for Complex Task Execution14 Dec 2023
Similar, not cited
Close in wording, no citation either way
- 2026Integrating Large Language Model Agents with Digital Twins for Industrial Autonomous Systems
- 2024BMW Agents -- A Framework For Task Automation Through Multi-Agent Collaboration
- 2026LLM-Driven Multi-Agent Control for Skill-Based Smart Manufacturing
- 2024Specifications: The missing link to making the development of LLM systems an engineering discipline
- 2026Logic-Based Verification of Task Allocation for LLM-Enabled Multi-Agent Manufacturing Systems
- 2026Foundation-Model-Based Agents in Industrial Automation: Purposes, Capabilities, and Open Challenges
- 2026IMR-LLM: Industrial Multi-Robot Task Planning and Program Generation using Large Language Models ↗
- 2024Large Language Model-Enabled Multi-Agent Manufacturing Systems