Retrieval Is Not Enough: Why Organizational AI Needs Epistemic Infrastructure
Not on the map. Why?
Abstract (arXiv)
Organizational knowledge used by AI agents typically lacks epistemic structure: retrieval systems surface semantically relevant content without distinguishing binding decisions from abandoned hypotheses, contested claims from settled ones, or known facts from unresolved questions. We argue that the ceiling on organizational AI is not retrieval fidelity but epistemic fidelity--the system's ability to represent commitment strength, contradiction status, and organizational ignorance as computable properties. We present OIDA, a framework that structures organizational knowledge as typed Knowledge Objects carrying epistemic class, importance scores with class-specific decay, and signed contradiction edges. The Knowledge Gravity Engine maintains scores deterministically with proved convergence guarantees (sufficient condition: max degree < 7; empirically robust to degree 43). OIDA introduces QUESTION-as-modeled-ignorance: a primitive with inverse decay that surfaces what an organization does not know with increasing urgency--a mechanism absent from all surveyed systems. We describe the Epistemic Quality Score (EQS), a five-component evaluation methodology with explicit circularity analysis. In a controlled comparison (n=10 response pairs), OIDA's RAG condition (3,868 tokens) achieves EQS 0.530 vs. 0.848 for a full-context baseline (108,687 tokens); the 28.1× token budget difference is the primary confound. The QUESTION mechanism is statistically validated (Fisher p=0.0325, OR=21.0). The formal properties are established; the decisive ablation at equal token budget (E4) is pre-registered and not yet run.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 39 references that are in the map. First posted on arXiv 13 Apr 2026.
Builds on
22 of 39 references.
References · 22
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
- 2024From Local to Global: A Graph RAG Approach to Query-Focused Summarizationcited by 1,453
- 2023MemGPT: Towards LLMs as Operating Systemscited by 1,389
- 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
- 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 841
- 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
- 2023Active Retrieval Augmented Generationcited by 516
- 2025Zep: A Temporal Knowledge Graph Architecture for Agent Memorycited by 400
- 2024LightRAG: Simple and Fast Retrieval-Augmented Generationcited by 315
- 2025Memory in the Age of AI Agentscited by 303
10 more
- 2024Knowledge Conflicts for LLMs: A Surveycited by 283
- 2024Retrieval Augmented Generation or Long-Context LLMs? A Comprehensive Study and Hybrid Approachcited by 119
- 2025MemOS: An Operating System for Memory-Augmented Generation (MAG) in Large Language Modelscited by 73
- 2024A Survey on Temporal Knowledge Graph: Representation Learning and Applicationscited by 30
- 2024Long Context vs. RAG for LLMs: An Evaluation and Revisitscited by 26
- 2024Long Context RAG Performance of Large Language Modelscited by 23
- 2024Signed Graph Representation Learning: A Surveycited by 7
- 2024Uncertainty Management in the Construction of Knowledge Graphs: a Surveycited by 5
- 2025Early Impacts of M365 Copilotcited by 3
- 2025Dealing with Inconsistency for Reasoning over Knowledge Graphs: A Surveycited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Architecting Trust in Artificial Epistemic Agents
- 2026AgenticRAG: Agentic Retrieval for Enterprise Knowledge Bases
- 2026Semantic Laundering in AI Agent Architectures: Why Tool Boundaries Do Not Confer Epistemic Warrant
- 2025The Epistemic Suite: A Post-Foundational Diagnostic Methodology for Assessing AI Knowledge Claims
- 2025Epistemological Fault Lines Between Human and Artificial Intelligence
- 2026The Missing Knowledge Layer in Cognitive Architectures for AI Agents
- 2026AI scientists produce results without reasoning scientifically
- 2026ContextNest: Verifiable Context Governance for Autonomous AI Agent