From Accuracy to Impact: The Impact-Driven AI Framework (IDAIF) for Aligning Engineering Architecture with Theory of Change
Not on the map. Why?
Abstract (arXiv)
This paper introduces the Impact-Driven AI Framework (IDAIF), a novel architectural methodology that integrates Theory of Change (ToC) principles with modern artificial intelligence system design. As AI systems increasingly influence high-stakes domains including healthcare, finance, and public policy, the alignment problem--ensuring AI behavior corresponds with human values and intentions--has become critical. Current approaches predominantly optimize technical performance metrics while neglecting the sociotechnical dimensions of AI deployment. IDAIF addresses this gap by establishing a systematic mapping between ToC's five-stage model (Inputs-Activities-Outputs-Outcomes-Impact) and corresponding AI architectural layers (Data Layer-Pipeline Layer-Inference Layer-Agentic Layer-Normative Layer). Each layer incorporates rigorous theoretical foundations: multi-objective Pareto optimization for value alignment, hierarchical multi-agent orchestration for outcome achievement, causal directed acyclic graphs (DAGs) for hallucination mitigation, and adversarial debiasing with Reinforcement Learning from Human Feedback (RLHF) for fairness assurance. We provide formal mathematical formulations for each component and introduce an Assurance Layer that manages assumption failures through guardian architectures. Three case studies demonstrate IDAIF application across healthcare, cybersecurity, and software engineering domains. This framework represents a paradigm shift from model-centric to impact-centric AI development, providing engineers with concrete architectural patterns for building ethical, trustworthy, and socially beneficial AI systems.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 17 of its 46 references that are in the map. First posted on arXiv 9 Dec 2025.
Builds on
17 of 46 references.
References · 17
- 2020Language Models are Few-Shot Learnerscited by 32,199
- 2022Training language models to follow instructions with human feedbackcited by 15,712
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2021Evaluating Large Language Models Trained on Codecited by 8,053
- 2020Extracting Training Data from Large Language Modelscited by 2,144
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2018Mitigating Unwanted Biases with Adversarial Learningcited by 663
- 2016Inherent Trade-Offs in the Fair Determination of Risk Scorescited by 582
- 2023Multi-Agent Collaboration: Harnessing the Power of Intelligent LLM Agentscited by 329
- 2018Failing Loudly: An Empirical Study of Methods for Detecting Dataset Shiftcited by 240
- 2022Do Users Write More Insecure Code with AI Assistants?cited by 186
5 more
- 2020Minimax Pareto Fairness: A Multi Objective Perspectivecited by 152
- 2016Research Priorities for Robust and Beneficial Artificial Intelligencecited by 74
- 2025Mitigating Hallucinations in Large Language Models via Causal Reasoningcited by 13
- 2025Fairness in Multi-modal Medical Diagnosis with Demonstration Selectioncited by 1
- 2025Developing Fairness-Aware Task Decomposition to Improve Equity in Post-Spinal Fusion Complication Predictioncited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2024Position: Towards Bidirectional Human-AI Alignment
- 2026AI Deployment Accountability Engineering: A Vision for Accountable AI in Safety-Critical Socio-Technical Systems
- 2023A Multi-Level Framework for the AI Alignment Problem
- 2025Moral Anchor System: A Predictive Framework for AI Value Alignment and Drift Prevention
- 2026Institutional AI: A Governance Framework for Distributional AGI Safety
- 2026Risk Architecture for AI-Native Engineering Teams: An Organizational Framework for Agentic System Governance
- 2025Alignment, Agency and Autonomy in Frontier AI: A Systems Engineering Perspective
- 2026Generative AI for Social Impact