mlsanityData to 7 Oct 2026

Pre-Trained Large Language Models for Industrial Control

arXiv 2308.03028 ↗First posted 6 Aug 2023cs.AIcited by 15

Not on the map. Why?

Abstract (arXiv)

For industrial control, developing high-performance controllers with few samples and low technical debt is appealing. Foundation models, possessing rich prior knowledge obtained from pre-training with Internet-scale corpus, have the potential to be a good controller with proper prompts. In this paper, we take HVAC (Heating, Ventilation, and Air Conditioning) building control as an example to examine the ability of GPT-4 (one of the first-tier foundation models) as the controller. To control HVAC, we wrap the task as a language game by providing text including a short description for the task, several selected demonstrations, and the current observation to GPT-4 on each step and execute the actions responded by GPT-4. We conduct series of experiments to answer the following questions: 1)~How well can GPT-4 control HVAC? 2)~How well can GPT-4 generalize to different scenarios for HVAC control? 3) How different parts of the text context affect the performance? In general, we found GPT-4 achieves the performance comparable to RL methods with few samples and low technical debt, indicating the potential of directly applying foundation models to industrial control tasks.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 56 of its 93 references that are in the map. First posted on arXiv 6 Aug 2023.

Builds on

56 of 93 references.

References · 56

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2022Training language models to follow instructions with human feedbackcited by 15,712
  6. 2017Proximal Policy Optimization Algorithmscited by 14,441
  7. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  8. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  9. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  10. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  11. 2021Zero-Shot Text-to-Image Generationcited by 4,276
  12. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
38 more
  1. 2021Prefix-Tuning: Optimizing Continuous Prompts for Generationcited by 3,878
  2. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,769
  3. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,155
  4. 2022Scaling Instruction-Finetuned Language Modelscited by 2,997
  5. 2023Sparks of Artificial General Intelligence: Early experiments with GPT-4cited by 2,579
  6. 2023A Survey of Large Language Modelscited by 2,537
  7. 2015Trust Region Policy Optimizationcited by 2,503
  8. 2022Emergent Abilities of Large Language Modelscited by 2,483
  9. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  10. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  11. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  12. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,528
  13. 2022Rethinking the Role of Demonstrations: What Makes In-Context Learning Work?cited by 1,413
  14. 2021Calibrate Before Use: Improving Few-Shot Performance of Language Modelscited by 1,371
  15. 2021What Makes Good In-Context Examples for GPT-3?cited by 1,184
  16. 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,172
  17. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,168
  18. 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
  19. 2023Reasoning with Language Model is Planning with World Modelcited by 846
  20. 2022A Generalist Agentcited by 802
  21. 2023AGIEval: A Human-Centric Benchmark for Evaluating Foundation Modelscited by 701
  22. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  23. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  24. 2021Habitat 2.0: Training Home Assistants to Rearrange their Habitatcited by 501
  25. 2018Universal Sentence Encodercited by 485
  26. 2022MineDojo: Building Open-Ended Embodied Agents with Internet-Scale Knowledgecited by 469
  27. 2023Describe, Explain, Plan and Select: Interactive Planning with Large Language Models Enables Open-World Multi-Task Agentscited by 396
  28. 2023A Comprehensive Survey on Pretrained Foundation Models: A History from BERT to ChatGPTcited by 364
  29. 2022RLPrompt: Optimizing Discrete Text Prompts with Reinforcement Learningcited by 361
  30. 2022Video PreTraining (VPT): Learning to Act by Watching Unlabeled Online Videoscited by 338
  31. 2023Ghost in the Minecraft: Generally Capable Agents for Open-World Environments via Large Language Models with Text-based Knowledge and Memorycited by 288
  32. 2023Reward Design with Language Modelscited by 257
  33. 2019Extrapolating Beyond Suboptimal Demonstrations via Inverse Reinforcement Learning from Observationscited by 256
  34. 2022Black-Box Tuning for Language-Model-as-a-Servicecited by 254
  35. 2023The False Promise of Imitating Proprietary LLMscited by 254
  36. 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 238
  37. 2023Grounding Large Language Models in Interactive Environments with Online Reinforcement Learningcited by 193
  38. 2023Guiding Pretraining in Reinforcement Learning with Large Language Modelscited by 185

50 most cited of 56 All 56 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 4; 2025: 5; 2026: 6.

15 papers.

Sort:

By area:

  1. 2024Autonomous Industrial Control using an Agentic Framework with Large Language Modelscited by 19
  2. 2024Agentic LLMs in the Supply Chain: Towards Autonomous Multi-Agent Consensus-Seekingcited by 16
  3. 2025Leveraging LLM Agents and Digital Twins for Fault Handling in Process Plantscited by 9
  4. 2024Using Large Language Models for Parametric Shape Optimizationcited by 7
  5. 2025Foundation Models for CPS-IoT: Opportunities and Challengescited by 5
  6. 2025A Survey of Foundation Models for IoT: Taxonomy and Criteria-Based Analysiscited by 5
  7. 2025A Status Quo Investigation of Large Language Models towards Cost-Effective CFD Automation with OpenFOAMGPT: ChatGPT vs. Qwen vs. Deepseekcited by 3
  8. 2024Training microrobots to swim by a large language modelcited by 2
  9. 2026From Detection to Action: Using LLM Agents for Fault-Tolerant Controlcited by 2
  10. 2026DCoPilot: Generative AI-Empowered Policy Adaptation for Dynamic Data Center Operationscited by 1
  11. 2026Verifier-Based Reinforcement Fine-Tuning of Reasoning Models for Thermal Energy Storage Controlcited by 1
  12. 2025FurniMAS: Language-Guided Furniture Decoration using Multi-Agent Systemcited by 0
3 more
  1. 2026A Tutorial on Autonomous Fault-Tolerant Control Using Knowledge-Grounded LLM Agentscited by 0
  2. 2026Exact Action Values Are Not Enough: Rollout-Verified Reinforcement Fine-Tuning of a Reasoning Model for Multi-Zone VAV Controlcited by 0
  3. 2026Large Language Models in the Loop: A Stability- and Network-Aware Survey in Networked Control, Cyber-Physical, and Multi-Agent Systemscited by 0