Engineering Safety Requirements for Autonomous Driving with Large Language Models
On the map: End-to-end autonomous driving → Large language models for driving
Abstract (arXiv)
Changes and updates in the requirement artifacts, which can be frequent in the automotive domain, are a challenge for SafetyOps. Large Language Models (LLMs), with their impressive natural language understanding and generating capabilities, can play a key role in automatically refining and decomposing requirements after each update. In this study, we propose a prototype of a pipeline of prompts and LLMs that receives an item definition and outputs solutions in the form of safety requirements. This pipeline also performs a review of the requirement dataset and identifies redundant or contradictory requirements. We first identified the necessary characteristics for performing HARA and then defined tests to assess an LLM's capability in meeting these criteria. We used design science with multiple iterations and let experts from different companies evaluate each cycle quantitatively and qualitatively. Finally, the prototype was implemented at a case company and the responsible team evaluated its efficiency.
Key facts. Cited by 14 papers in the map (data through 7 Oct 2026). Placed in Large language models for driving, one of 9 directions in End-to-end autonomous driving. Builds on 10 of its 29 references that are in the map. First posted on arXiv 24 Mar 2024.
Builds on
10 of 29 references.
References · 10
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2023A Prompt Pattern Catalog to Enhance Prompt Engineering with ChatGPTcited by 612
- 20206-Layer Model for a Structured Description and Categorization of Urban Traffic and Environmentcited by 26
- 2023Safety Analysis in the Era of Large Language Models: A Case Study of STPA using ChatGPTcited by 13
- 2023ChatGPT is on the Horizon: Could a Large Language Model be Suitable for Intelligent Traffic Safety Research and Applications?cited by 9
- 2023Can Large Language Models assist in Hazard Analysis?cited by 8
- 2024Welcome Your New AI Teammate: On Safety Analysis by Leashing Large Language Modelscited by 8
- 2019Ethical Interviews in Software Engineeringcited by 3
- 2024An Industrial Experience Report about Challenges from Continuous Monitoring, Improvement, and Deployment for Autonomous Driving Featurescited by 3
- 2024On STPA for Distributed Development of Safe Autonomous Driving: An Interview Studycited by 2
Built on by
Citing papers per year: 2024: 4; 2025: 7; 2026: 3.
14 papers.
Sort:
By area:
- 2024Large Language Model-Based Agents for Software Engineering: A Surveycited by 173
- 2024From LLMs to LLM-based Agents for Software Engineering: A Survey of Current, Challenges and Futurecited by 85
- 2024Generating and Evolving Reward Functions for Highway Driving with Large Language Modelscited by 8
- 2024XLM for Autonomous Driving Systems: A Comprehensive Reviewcited by 5
- 2025On Simulation-Guided LLM-based Code Generation for Safe Autonomous Driving Softwarecited by 3
- 2025Can LLMs Generate User Stories and Assess Their Quality?cited by 2
- 2025Large Language Models in Code Co-generation for Safe Autonomous Vehiclescited by 1
- 2025A Systematic Literature Review on Safety of the Intended Functionality for Automated Driving Systemscited by 0
- 2025Working Document -- Formalising Software Requirements with Large Language Modelscited by 0
- 2025Systems-Theoretic and Data-Driven Security Analysis in ML-enabled Medical Devicescited by 0
- 2025Do AI Models Dream of Faster Code? An Empirical Study on LLM-Proposed Performance Improvements in Real-World Softwarecited by 0
- 2026Traceable LLM-Generated Hazard Scenarios for Operational Safety Analysis of Aviation Systems Using ASRS Reportscited by 0
- 2026Context operations to architecture modelling output from large language models and evaluation criteria for their use in systems engineering design9 Sep 2026
- 2026From Safety Documentation to Safety Knowledge Support: An Evidence-Grounded LLM Framework for Medical Devices12 Aug 2026
- 2026Traceable LLM-Generated Hazard Scenarios for Operational Safety Analysis of Aviation Systems Using ASRS Reports5 Aug 2026
- 2025Do AI Models Dream of Faster Code? An Empirical Study on LLM-Proposed Performance Improvements in Real-World Software17 Oct 2025
- 2025Can LLMs Generate User Stories and Assess Their Quality?20 Jul 2025
- 2025Systems-Theoretic and Data-Driven Security Analysis in ML-enabled Medical Devices18 Jun 2025
- 2025Working Document -- Formalising Software Requirements with Large Language Models17 Jun 2025
- 2025Large Language Models in Code Co-generation for Safe Autonomous Vehicles26 May 2025
- 2025On Simulation-Guided LLM-based Code Generation for Safe Autonomous Driving Software2 Apr 2025
- 2025A Systematic Literature Review on Safety of the Intended Functionality for Automated Driving Systems4 Mar 2025
- 2024XLM for Autonomous Driving Systems: A Comprehensive Review16 Sep 2024
- 2024Large Language Model-Based Agents for Software Engineering: A Survey4 Sep 2024
- 2024Generating and Evolving Reward Functions for Highway Driving with Large Language Modelscited by 8
- 2024XLM for Autonomous Driving Systems: A Comprehensive Reviewcited by 5
- 2025On Simulation-Guided LLM-based Code Generation for Safe Autonomous Driving Softwarecited by 3
- 2025Large Language Models in Code Co-generation for Safe Autonomous Vehiclescited by 1
- 2025Large Language Models in Code Co-generation for Safe Autonomous Vehicles26 May 2025
- 2025On Simulation-Guided LLM-based Code Generation for Safe Autonomous Driving Software2 Apr 2025
- 2024XLM for Autonomous Driving Systems: A Comprehensive Review16 Sep 2024
- 2024Generating and Evolving Reward Functions for Highway Driving with Large Language Models15 Jun 2024
- 2025Can LLMs Generate User Stories and Assess Their Quality?cited by 2
- 2025A Systematic Literature Review on Safety of the Intended Functionality for Automated Driving Systemscited by 0
- 2025Working Document -- Formalising Software Requirements with Large Language Modelscited by 0
- 2025Systems-Theoretic and Data-Driven Security Analysis in ML-enabled Medical Devicescited by 0
- 2025Do AI Models Dream of Faster Code? An Empirical Study on LLM-Proposed Performance Improvements in Real-World Softwarecited by 0
- 2026Traceable LLM-Generated Hazard Scenarios for Operational Safety Analysis of Aviation Systems Using ASRS Reportscited by 0
- 2026From Safety Documentation to Safety Knowledge Support: An Evidence-Grounded LLM Framework for Medical Devicescited by 0
- 2026Context operations to architecture modelling output from large language models and evaluation criteria for their use in systems engineering designcited by 0
- 2026Context operations to architecture modelling output from large language models and evaluation criteria for their use in systems engineering design9 Sep 2026
- 2026From Safety Documentation to Safety Knowledge Support: An Evidence-Grounded LLM Framework for Medical Devices12 Aug 2026
- 2026Traceable LLM-Generated Hazard Scenarios for Operational Safety Analysis of Aviation Systems Using ASRS Reports5 Aug 2026
- 2025Do AI Models Dream of Faster Code? An Empirical Study on LLM-Proposed Performance Improvements in Real-World Software17 Oct 2025
- 2025Can LLMs Generate User Stories and Assess Their Quality?20 Jul 2025
- 2025Systems-Theoretic and Data-Driven Security Analysis in ML-enabled Medical Devices18 Jun 2025
- 2025Working Document -- Formalising Software Requirements with Large Language Models17 Jun 2025
- 2025A Systematic Literature Review on Safety of the Intended Functionality for Automated Driving Systems4 Mar 2025
Similar, not cited
Close in wording, no citation either way
- 2025Are requirements really all you need? A case study of LLM-driven configuration code generation for automotive simulations
- 2023Empowering Autonomous Driving with Large Language Models: A Safety Perspective
- 2026DriveSafe: A Hierarchical Risk Taxonomy for Safety-Critical LLM-Based Driving Assistants
- 2025A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment
- 2023Human-Centric Autonomous Systems With LLMs for User Command Reasoning
- 2025David vs. Goliath: A comparative study of different-sized LLMs for code generation in the domain of automotive scenario generation
- 2025Towards Automated Safety Requirements Derivation Using Agent-based RAG
- 2026SAFARI: An Industrial Benchmark for LLM-Assisted Hazard Analysis and Risk Assessment