From Safety Documentation to Safety Knowledge Support: An Evidence-Grounded LLM Framework for Medical Devices
Not on the map. Why?
Abstract (arXiv)
Medical devices are becoming more software-intensive, connected, and AI-enabled. Their development requires risk-management evidence aligned with ISO 14971 and, for software, IEC 62304. This evidence must be kept consistent across requirements, design decisions, software changes, verification results, complaints, and post-market data. These tasks are costly and depend on scarce safety and domain experts. Large language models (LLMs) may reduce parts of this effort because medical-device safety work is highly document-based. However, current LLM-based safety-engineering studies often address isolated methods, rely on generic prompting or public examples, and provide limited support for source links, traceability, uncertainty handling, lifecycle updates, and recorded expert review. This limits their use in regulated medical-device development. This paper argues that the central research problem is not safety-text generation, but source-linked safety-knowledge support. We propose an evidence-grounded framework that connects device artifacts, controlled knowledge storage and retrieval, method-specific generation of candidate safety items, critique and uncertainty checks, and recorded expert review. The framework prepares, links, checks, and updates candidate safety artifacts for expert decision-making. It does not decide whether a device is safe and does not provide regulatory approval. We also outline an evaluation strategy using non-public or newly built medical-device case studies and expert reference analyses to assess coverage, correctness, relevance, traceability, duplicate rate, unsupported claims, and review effort.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 10 of its 35 references that are in the map. First posted on arXiv 12 Aug 2026.
Builds on
10 of 35 references.
References · 10
- 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 348
- 2024Engineering Safety Requirements for Autonomous Driving with Large Language Modelscited by 14
- 2023Can Large Language Models assist in Hazard Analysis?cited by 8
- 2024Welcome Your New AI Teammate: On Safety Analysis by Leashing Large Language Modelscited by 8
- 2024Aegis:An Advanced LLM-Based Multi-Agent for Intelligent Functional Safety Engineeringcited by 7
- 2025From Hazard Identification to Controller Design: Proactive and LLM-Supported Safety Engineering for ML-Powered Systemscited by 7
- 2024Evaluating the Effectiveness of GPT-4 Turbo in Creating Defeaters for Assurance Casescited by 6
- 2024CoDefeater: Using LLMs To Find Defeaters in Assurance Casescited by 5
- 2025An LLM-Integrated Framework for Completion, Management, and Tracing of STPAcited by 2
- 2025Towards Automated Safety Requirements Derivation Using Agent-based RAGcited by 2
Built on by
Not cited yet.