mlsanityData to 14 Oct 2026

LAAF: A Layered Accountability Architecture Framework for LLM Applications

arXiv 2608.27102 ↗First posted 27 Aug 2026cs.AI cs.CRcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) operate in hospitals, courtrooms, banks, and public service desks, where fluent, confident outputs are treated as authoritative even when ungrounded or incorrect. When such an output contributes to harm, who is answerable, and through what mechanisms can responsibility be traced, explained, and acted upon? Following PRISMA guidance, five databases were searched from January 2022 to March 2026 against four review questions; of 4,512 records identified, 122 primary studies were included, together with 12 regulatory and standards documents analysed as primary sources. The review consolidates a sociotechnical account of accountability as an actor-forum relation resolved into five dimensions, and synthesises mechanisms across four families: technical controls, human oversight, organisational governance, and documentation and traceability, each with a maturity assessment. The corpus is read through a four-layer classification device spanning provenance, application logic, human oversight, and governance and redress, cross-cut by traceability, role clarity, and continuous monitoring. Both are mapped onto the EU AI Act, whose high-risk obligations have applied since 2 August 2026, the NIST AI RMF with its Generative AI Profile, ISO/IEC 42001, and sectoral guidance in healthcare, consumer finance, education, and the public sector. Four persistent gaps emerge: under-specification of human oversight, absence of shared accountability metrics, disciplinary disconnection, and limited empirical evaluation, alongside five structural tensions that no surveyed instrument resolves. The review closes by consolidating the classification device into an integrated accountability architecture, LAAF, with cybersecurity aligned to the OWASP LLM Top 10 (2025); it is a synthesis of the surveyed evidence rather than a validated artefact.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 58 of its 112 references that are in the map. First posted on arXiv 27 Aug 2026.

Builds on

58 of 112 references.

References · 58

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
  3. 2023A Survey of Large Language Modelscited by 2,576
  4. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  5. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  6. 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
  7. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  8. 2018Datasheets for Datasetscited by 1,386
  9. 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
  10. 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
  11. 2018Model Cards for Model Reportingcited by 1,080
  12. 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
38 more
  1. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
  2. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  3. 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
  4. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 729
  5. 2023A Watermark for Large Language Modelscited by 725
  6. 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
  7. 2023Bias and Fairness in Large Language Models: A Surveycited by 639
  8. 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
  9. 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
  10. 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 384
  11. 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 365
  12. 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 341
  13. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332
  14. 2023Provable Robust Watermarking for AI-Generated Textcited by 299
  15. 2025Survey on Evaluation of LLM-based Agentscited by 204
  16. 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 186
  17. 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
  18. 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 162
  19. 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 157
  20. 2024Large Legal Fictions: Profiling Legal Hallucinations in Large Language Modelscited by 150
  21. 2024Fine-grained Hallucination Detection and Editing for Language Modelscited by 149
  22. 2023Auditing large language models: a three-layered approachcited by 137
  23. 2023Calibrated Language Models Must Hallucinatecited by 115
  24. 2022Explanations Can Reduce Overreliance on AI Systems During Decision-Makingcited by 111
  25. 2023Regulating ChatGPT and other Large Generative AI Modelscited by 104
  26. 2021Demystifying the Draft EU Artificial Intelligence Actcited by 84
  27. 2023The Foundation Model Transparency Indexcited by 66
  28. 2021The Flaws of Policies Requiring Human Oversight of Government Algorithmscited by 44
  29. 2022Advancing Human-AI Complementarity: The Impact of User Expertise and Algorithmic Tuning on Joint Decision Makingcited by 33
  30. 2024On the Quest for Effectiveness in Human Oversight: Interdisciplinary Perspectivescited by 28
  31. 2024Towards Trustworthy AI: A Review of Ethical and Robust Large Language Modelscited by 22
  32. 2024Assessing Adversarial Robustness of Large Language Models: An Empirical Studycited by 21
  33. 2023Large Language Models for Propaganda Span Annotationcited by 19
  34. 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
  35. 2024Green AI: Exploring Carbon Footprints, Mitigation Strategies, and Trade Offs in Large Language Model Trainingcited by 15
  36. 2024DAGER: Exact Gradient Inversion for Large Language Modelscited by 14
  37. 2024Empowering Large Language Models to Set up a Knowledge Retrieval Indexer via Self-Learningcited by 13
  38. 2024A Survey of Large Language Models in Cybersecuritycited by 8

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.