Pre-Trained Large Language Models for Industrial Control
Not on the map. Why?
Abstract (arXiv)
For industrial control, developing high-performance controllers with few samples and low technical debt is appealing. Foundation models, possessing rich prior knowledge obtained from pre-training with Internet-scale corpus, have the potential to be a good controller with proper prompts. In this paper, we take HVAC (Heating, Ventilation, and Air Conditioning) building control as an example to examine the ability of GPT-4 (one of the first-tier foundation models) as the controller. To control HVAC, we wrap the task as a language game by providing text including a short description for the task, several selected demonstrations, and the current observation to GPT-4 on each step and execute the actions responded by GPT-4. We conduct series of experiments to answer the following questions: 1)~How well can GPT-4 control HVAC? 2)~How well can GPT-4 generalize to different scenarios for HVAC control? 3) How different parts of the text context affect the performance? In general, we found GPT-4 achieves the performance comparable to RL methods with few samples and low technical debt, indicating the potential of directly applying foundation models to industrial control tasks.
Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 56 of its 93 references that are in the map. First posted on arXiv 6 Aug 2023.
Builds on
56 of 93 references.
References · 56
- 2017Attention Is All You Needcited by 59,932
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2021Zero-Shot Text-to-Image Generationcited by 4,276
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
38 more
- 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
- 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
- 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
- 2023A Survey of Large Language Modelscited by 2,537
- 2015Trust Region Policy Optimizationcited by 2,503
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
- 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
- 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
- 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
- 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2023Reasoning with Language Model is Planning with World Modelcited by 846
- 2022A Generalist Agentcited by 802
- 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 701
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
- 2018Universal Sentence Encodercited by 485
- 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
- 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
- 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
- 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 361
- 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 338
- 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
- 2023Reward Design with Language Modelscited by 257
- 2019Extrapolating Beyond Suboptimal Demonstrations via Inverse Reinforcement Learning from Observationscited by 256
- 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 254
- 2023The False Promise of Imitating Proprietary LLMscited by 254
- 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 238
- 2023Grounding Large Language Models in Interactive Environments with Online Reinforcement Learningcited by 193
- 2023Guiding Pretraining in Reinforcement Learning with Large Language Modelscited by 185
50 most cited of 56 All 56 (JSON)
Built on by
Citing papers per year: 2024: 4; 2025: 5; 2026: 6.
15 papers.
Sort:
By area:
- 2024Autonomous Industrial Control using an Agentic Framework with Large Language Modelscited by 19
- 2024Agentic LLMs in the Supply Chain: Towards Autonomous Multi-Agent Consensus-Seekingcited by 16
- 2025Leveraging LLM Agents and Digital Twins for Fault Handling in Process Plantscited by 9
- 2024Using Large Language Models for Parametric Shape Optimizationcited by 7
- 2025Foundation Models for CPS-IoT: Opportunities and Challengescited by 5
- 2025A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysiscited by 5
- 2025A Status Quo Investigation of Large Language Models towards Cost-Effective CFD Automation with OpenFOAMGPT: ChatGPT vs. Qwen vs. Deepseekcited by 3
- 2024Training microrobots to swim by a large language modelcited by 2
- 2026From Detection to Action: Using LLM Agents for Fault-Tolerant Controlcited by 2
- 2026DCoPilot: Generative AI-Empowered Policy Adaptation for Dynamic Data Center Operationscited by 1
- 2026Verifier-Based Reinforcement Fine-Tuning of Reasoning Models for Thermal Energy Storage Controlcited by 1
- 2025FurniMAS: Language-Guided Furniture Decoration using Multi-Agent Systemcited by 0
3 more
- 2026A Tutorial on Autonomous Fault-Tolerant Control Using Knowledge-Grounded LLM Agentscited by 0
- 2026Exact Action Values Are Not Enough: Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone VAV Controlcited by 0
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systemscited by 0
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systems15 Sep 2026
- 2026Exact Action Values Are Not Enough: Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone VAV Control30 Jul 2026
- 2026Verifier-Based Reinforcement Fine-Tuning of Reasoning Models for Thermal Energy Storage Control14 Jul 2026
- 2026A Tutorial on Autonomous Fault-Tolerant Control Using Knowledge-Grounded LLM Agents30 Jun 2026
- 2026From Detection to Action: Using LLM Agents for Fault-Tolerant Control26 Jun 2026
- 2026DCoPilot: Generative AI-Empowered Policy Adaptation for Dynamic Data Center Operations2 Feb 2026
- 2025FurniMAS: Language-Guided Furniture Decoration using Multi-Agent System7 Jul 2025
- 2025A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysis13 Jun 2025
- 2025Leveraging LLM Agents and Digital Twins for Fault Handling in Process Plants4 May 2025
- 2025A Status Quo Investigation of Large Language Models towards Cost-Effective CFD Automation with OpenFOAMGPT: ChatGPT vs. Qwen vs. Deepseek2 Apr 2025
- 2025Foundation Models for CPS-IoT: Opportunities and Challenges22 Jan 2025
- 2024Using Large Language Models for Parametric Shape Optimization11 Dec 2024
- 2024Autonomous Industrial Control using an Agentic Framework with Large Language Modelscited by 19
- 2024Agentic LLMs in the Supply Chain: Towards Autonomous Multi-Agent Consensus-Seekingcited by 16
- 2025Leveraging LLM Agents and Digital Twins for Fault Handling in Process Plantscited by 9
- 2026From Detection to Action: Using LLM Agents for Fault-Tolerant Controlcited by 2
- 2025FurniMAS: Language-Guided Furniture Decoration using Multi-Agent Systemcited by 0
- 2026A Tutorial on Autonomous Fault-Tolerant Control Using Knowledge-Grounded LLM Agentscited by 0
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systemscited by 0
- 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systems15 Sep 2026
- 2026A Tutorial on Autonomous Fault-Tolerant Control Using Knowledge-Grounded LLM Agents30 Jun 2026
- 2026From Detection to Action: Using LLM Agents for Fault-Tolerant Control26 Jun 2026
- 2025FurniMAS: Language-Guided Furniture Decoration using Multi-Agent System7 Jul 2025
- 2025Leveraging LLM Agents and Digital Twins for Fault Handling in Process Plants4 May 2025
- 2024Agentic LLMs in the Supply Chain: Towards Autonomous Multi-Agent Consensus-Seeking15 Nov 2024
- 2024Autonomous Industrial Control using an Agentic Framework with Large Language Models8 Nov 2024
- 2024Using Large Language Models for Parametric Shape Optimizationcited by 7
- 2025Foundation Models for CPS-IoT: Opportunities and Challengescited by 5
- 2025A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysiscited by 5
- 2025A Status Quo Investigation of Large Language Models towards Cost-Effective CFD Automation with OpenFOAMGPT: ChatGPT vs. Qwen vs. Deepseekcited by 3
- 2024Training microrobots to swim by a large language modelcited by 2
- 2026DCoPilot: Generative AI-Empowered Policy Adaptation for Dynamic Data Center Operationscited by 1
- 2026DCoPilot: Generative AI-Empowered Policy Adaptation for Dynamic Data Center Operations2 Feb 2026
- 2025A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysis13 Jun 2025
- 2025A Status Quo Investigation of Large Language Models towards Cost-Effective CFD Automation with OpenFOAMGPT: ChatGPT vs. Qwen vs. Deepseek2 Apr 2025
- 2025Foundation Models for CPS-IoT: Opportunities and Challenges22 Jan 2025
- 2024Using Large Language Models for Parametric Shape Optimization11 Dec 2024
- 2024Training microrobots to swim by a large language model21 Jan 2024