LAAF: A Layered Accountability Architecture Framework for LLM Applications
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) operate in hospitals, courtrooms, banks, and public service desks, where fluent, confident outputs are treated as authoritative even when ungrounded or incorrect. When such an output contributes to harm, who is answerable, and through what mechanisms can responsibility be traced, explained, and acted upon? Following PRISMA guidance, five databases were searched from January 2022 to March 2026 against four review questions; of 4,512 records identified, 122 primary studies were included, together with 12 regulatory and standards documents analysed as primary sources. The review consolidates a sociotechnical account of accountability as an actor-forum relation resolved into five dimensions, and synthesises mechanisms across four families: technical controls, human oversight, organisational governance, and documentation and traceability, each with a maturity assessment. The corpus is read through a four-layer classification device spanning provenance, application logic, human oversight, and governance and redress, cross-cut by traceability, role clarity, and continuous monitoring. Both are mapped onto the EU AI Act, whose high-risk obligations have applied since 2 August 2026, the NIST AI RMF with its Generative AI Profile, ISO/IEC 42001, and sectoral guidance in healthcare, consumer finance, education, and the public sector. Four persistent gaps emerge: under-specification of human oversight, absence of shared accountability metrics, disciplinary disconnection, and limited empirical evaluation, alongside five structural tensions that no surveyed instrument resolves. The review closes by consolidating the classification device into an integrated accountability architecture, LAAF, with cybersecurity aligned to the OWASP LLM Top 10 (2025); it is a synthesis of the surveyed evidence rather than a validated artefact.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 58 of its 112 references that are in the map. First posted on arXiv 27 Aug 2026.
Builds on
58 of 112 references.
References · 58
- 2017Attention Is All You Needcited by 60,361
- 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,975
- 2023A Survey of Large Language Modelscited by 2,576
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2023Not what you've signed up for: Compromising Real-World LLM-Integrated Applications with Indirect Prompt Injectioncited by 1,443
- 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
- 2018Datasheets for Datasetscited by 1,386
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2023Llama Guard: LLM-based Input-Output Safeguard for Human-AI Conversationscited by 1,207
- 2018Model Cards for Model Reportingcited by 1,080
- 2022Atlas: Few-shot Learning with Retrieval Augmented Language Modelscited by 952
38 more
- 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 819
- 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
- 2022Teaching Models to Express Their Uncertainty in Wordscited by 751
- 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 729
- 2023A Watermark for Large Language Modelscited by 725
- 2021BBQ: A Hand-Built Bias Benchmark for Question Answeringcited by 701
- 2023Bias and Fairness in Large Language Models: A Surveycited by 639
- 2021BOLD: Dataset and Metrics for Measuring Biases in Open-Ended Language Generationcited by 412
- 2020Does the Whole Exceed its Parts? The Effect of AI Explanations on Complementary Team Performancecited by 399
- 2020Closing the AI Accountability Gap: Defining an End-to-End Framework for Internal Algorithmic Auditingcited by 384
- 2023NeMo Guardrails: A Toolkit for Controllable and Safe LLM Applications with Programmable Railscited by 365
- 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 341
- 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332
- 2023Provable Robust Watermarking for AI-Generated Textcited by 299
- 2025Survey on Evaluation of LLM-based Agentscited by 204
- 2024Security and Privacy Challenges of Large Language Models: A Surveycited by 186
- 2023A Survey of Large Language Models for Healthcare: from Data, Technology, and Applications to Accountability and Ethicscited by 163
- 2022"I'm sorry to hear that": Finding New Biases in Language Models with a Holistic Descriptor Datasetcited by 162
- 2023Sociotechnical Safety Evaluation of Generative AI Systemscited by 157
- 2024Large Legal Fictions: Profiling Legal Hallucinations in Large Language Modelscited by 150
- 2024Fine-grained Hallucination Detection and Editing for Language Modelscited by 149
- 2023Auditing large language models: a three-layered approachcited by 137
- 2023Calibrated Language Models Must Hallucinatecited by 115
- 2022Explanations Can Reduce Overreliance on AI Systems During Decision-Makingcited by 111
- 2023Regulating ChatGPT and other Large Generative AI Modelscited by 104
- 2021Demystifying the Draft EU Artificial Intelligence Actcited by 84
- 2023The Foundation Model Transparency Indexcited by 66
- 2021The Flaws of Policies Requiring Human Oversight of Government Algorithmscited by 44
- 2022Advancing Human-AI Complementarity: The Impact of User Expertise and Algorithmic Tuning on Joint Decision Makingcited by 33
- 2024On the Quest for Effectiveness in Human Oversight: Interdisciplinary Perspectivescited by 28
- 2024Towards Trustworthy AI: A Review of Ethical and Robust Large Language Modelscited by 22
- 2024Assessing Adversarial Robustness of Large Language Models: An Empirical Studycited by 21
- 2023Large Language Models for Propaganda Span Annotationcited by 19
- 2024Mapping the Ethics of Generative AI: A Comprehensive Scoping Reviewcited by 19
- 2024Green AI: Exploring Carbon Footprints, Mitigation Strategies, and Trade Offs in Large Language Model Trainingcited by 15
- 2024DAGER: Exact Gradient Inversion for Large Language Modelscited by 14
- 2024Empowering Large Language Models to Set up a Knowledge Retrieval Indexer via Self-Learningcited by 13
- 2024A Survey of Large Language Models in Cybersecuritycited by 8
50 most cited of 58 All 58 (JSON)
Built on by
Not cited yet.