mlsanityData to 7 Oct 2026

Safety Analysis in the Era of Large Language Models: A Case Study of STPA using ChatGPT

arXiv 2304.01246 ↗First posted 3 Apr 2023cs.CL cs.AI cs.CYcited by 13

Not on the map. Why?

Abstract (arXiv)

Can safety analysis make use of Large Language Models (LLMs)? A case study explores Systems Theoretic Process Analysis (STPA) applied to Automatic Emergency Brake (AEB) and Electricity Demand Side Management (DSM) systems using ChatGPT. We investigate how collaboration schemes, input semantic complexity, and prompt guidelines influence STPA results. Comparative results show that using ChatGPT without human intervention may be inadequate due to reliability related issues, but with careful design, it may outperform human experts. No statistically significant differences are found when varying the input semantic complexity or using common prompt guidelines, which suggests the necessity for developing domain-specific prompt engineering. We also highlight future challenges, including concerns about LLM trustworthiness and the necessity for standardisation and regulation in this domain.

Key facts. Cited by 13 papers in the map (data through 7 Oct 2026). Builds on 27 of its 67 references that are in the map. First posted on arXiv 3 Apr 2023.

Builds on

27 of 67 references.

References · 27

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2020Language Models are Few-Shot Learnerscited by 32,199
  4. 2023GPT-4 Technical Reportcited by 18,132
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2020Scaling Laws for Neural Language Modelscited by 6,411
  8. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  9. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,195
  10. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,014
  11. 2019XLNet: Generalized Autoregressive Pretraining for Language Understandingcited by 2,801
  12. 2019ALBERT: A Lite BERT for Self-supervised Learning of Language Representationscited by 2,772
15 more
  1. 2023A Survey of Large Language Modelscited by 2,537
  2. 2020GShard: Scaling Giant Models with Conditional Computation and Automatic Shardingcited by 1,601
  3. 2022Least-to-Most Prompting Enables Complex Reasoning in Large Language Modelscited by 1,397
  4. 2019PEGASUS: Pre-training with Extracted Gap-sentences for Abstractive Summarizationcited by 1,100
  5. 2022Red Teaming Language Models with Language Modelscited by 983
  6. 2019CTRL: A Conditional Transformer Language Model for Controllable Generationcited by 754
  7. 2020Self-supervised Learning: Generative or Contrastivecited by 693
  8. 2020A Survey on Contrastive Self-supervised Learningcited by 553
  9. 2021Recent Advances in Natural Language Processing via Large Pre-Trained Language Models: A Surveycited by 457
  10. 2021QA-GNN: Reasoning with Language Models and Knowledge Graphs for Question Answeringcited by 386
  11. 2023On the Robustness of ChatGPT: An Adversarial and Out-of-distribution Perspectivecited by 208
  12. 2022Language models show human-like content effects on reasoning taskscited by 171
  13. 2021PanGu-α: Large-scale Autoregressive Pretrained Chinese Language Models with Auto-parallel Computationcited by 134
  14. 2021AMMUS : A Survey of Transformer-based Pretrained Models in Natural Language Processingcited by 131
  15. 2017Engineering Trustworthy Self-Adaptive Software with Dynamic Assurance Casescited by 14

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 2; 2024: 3; 2025: 4; 2026: 4.

13 papers.

Sort:

By area:

  1. 2023A Survey of Safety and Trustworthiness of Large Language Models through the Lens of Verification and Validationcited by 91
  2. 2024Engineering Safety Requirements for Autonomous Driving with Large Language Modelscited by 14
  3. 2023Provably Efficient Iterated CVaR Reinforcement Learning with Function Approximation and Human Feedbackcited by 13
  4. 2024Welcome Your New AI Teammate: On Safety Analysis by Leashing Large Language Modelscited by 8
  5. 2024Adopting RAG for LLM-Aided Future Vehicle Designcited by 6
  6. 2025An LLM-Integrated Framework for Completion, Management, and Tracing of STPAcited by 2
  7. 2025Towards Automated Safety Requirements Derivation Using Agent-based RAGcited by 2
  8. 2025A Hierarchical Imprecise Probability Approach to Reliability Assessment of Large Language Modelscited by 2
  9. 2025Systems-Theoretic and Data-Driven Security Analysis in ML-enabled Medical Devicescited by 0
  10. 2026Who Analyses the Analyser? Self-Validating LLM Hazard Analysis with Constitutional Meta-STPAcited by 0
  11. 2026Context operations to architecture modelling output from large language models and evaluation criteria for their use in systems engineering designcited by 0
  12. 2026SAFARI: An Industrial Benchmark for LLM-Assisted Hazard Analysis and Risk Assessmentcited by 0
1 more
  1. 2026Towards Systematic Qualification of Vision-Language Models for Automotive Perception Systemscited by 0