mlsanityData to 14 Oct 2026

AI Assurance in UK Defence: Challenges in Operationalising JSP 936

arXiv 2606.09414 ↗First posted 8 Jun 2026cs.HC cs.AIcited by 0

Not on the map. Why?

Abstract (arXiv)

This report examines practical challenges in operationalising JSP 936 Part 1 for AI assurance in UK Defence. Using a structured interpretive review of the directive's requirements, the analysis identifies eight thematic challenge areas adequacy of evidence and argument, management of human interaction with AI, definition of the operational environment, integration of AI within systems of systems, assessment and maintenance of AI performance, analysis of safety and security, measurement of ethicality, and mitigation of the inherent complexities of AI. The report argues that JSP 936 provides a useful governance basis, but that implementation depends on unresolved technical, organisational, and assurance questions. These challenges stem from the socio-technical nature of AI-enabled systems, uncertainty in real-world deployment contexts, limitations in current assurance methodologies, and tensions between performance, safety, human oversight, security, and ethical acceptability. The report identifies areas where further methods, guidance, and organisational capability are needed for the ambitious, safe, and responsible adoption of AI across Defence. This is consistent with MOD's own framing of JSP 936 as requiring iterative implementation and supporting guidance.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 29 of its 120 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

29 of 120 references.

References · 29

  1. 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,070
  2. 2017On Calibration of Modern Neural Networkscited by 4,960
  3. 2020Inductive Biases for Deep Learning of Higher-Level Cognitioncited by 275
  4. 2025Multi-Agent Risks from Advanced AIcited by 163
  5. 2022Quantifying Aleatoric and Epistemic Uncertainty in Machine Learning: Are Conditional Entropy and Mutual Information Appropriate Measures?cited by 125
  6. 2025Red-Teaming LLM Multi-Agent Systems via Communication Attackscited by 122
  7. 2023Fairness And Bias in Artificial Intelligence: A Brief Survey of Sources, Impacts, And Mitigation Strategiescited by 85
  8. 2025Emergent Abilities in Large Language Models: A Surveycited by 37
  9. 2024On the Quest for Effectiveness in Human Oversight: Interdisciplinary Perspectivescited by 28
  10. 2025Risk Analysis Techniques for Governed LLM-based Multi-Agent Systemscited by 18
  11. 2019Failure Modes in Machine Learning Systemscited by 15
  12. 2022Requirements Engineering for Artificial Intelligence Systems: A Systematic Mapping Studycited by 14
17 more
  1. 2025The BIG Argument for AI Safety Casescited by 12
  2. 2025Failure Modes in LLM Systems: A System-Level Taxonomy for Reliable AI Applicationscited by 10
  3. 2022Guidance on the Safety Assurance of Autonomous Systems in Complex Environments (SACE)cited by 8
  4. 2024From Silos to Systems: Process-Oriented Hazard Analysis for AI Systemscited by 6
  5. 2023Status Quo and Problems of Requirements Engineering for Machine Learning: Results from an International Surveycited by 5
  6. 2024Emergence in Multi-Agent Systems: A Safety Perspectivecited by 5
  7. 2024How Mature is Requirements Engineering for AI-based Systems? A Systematic Mapping Study on Practices, Challenges, and Future Research Directionscited by 5
  8. 2025AI Safety vs. AI Security: Demystifying the Distinction and Boundariescited by 5
  9. 2024Trustworthy Artificial Intelligence in the Context of Metrologycited by 4
  10. 2024Redefining Safety for Autonomous Vehiclescited by 3
  11. 2024Lessons from the Cruise Robotaxi Pedestrian Dragging Mishapcited by 3
  12. 2024A Black Swan Hypothesis: The Role of Human Irrationality in AI Safetycited by 3
  13. 2024Formalization of Operational Domain and Operational Design Domain for Automated Vehiclescited by 3
  14. 2025Out-of-Distribution Detection for Safety Assurance of AI and Autonomous Systemscited by 2
  15. 2023STEAM & MoSAFE: SOTIF Error-and-Failure Model & Analysis for AI-Enabled Driving Automationcited by 1
  16. 2024Building Trust: Foundations of Security, Safety and Transparency in AIcited by 1
  17. 2025Agile Management for Machine Learning: A Systematic Mapping Studycited by 1

Built on by

Not cited yet.