Tool Receipts, Not Zero-Knowledge Proofs: Practical Hallucination Detection for AI Agents
On the map: LLM agents and tool use → Medical and scientific domain agents
Abstract (arXiv)
AI agents that execute tasks via tool calls frequently hallucinate results - fabricating tool executions, misstating output counts, or presenting inferences as facts. Recent approaches to verifiable AI inference rely on zero-knowledge proofs, which provide cryptographic guarantees but impose minutes of proving time per query, making them impractical for interactive agents. We propose NabaOS, a lightweight verification framework inspired by Indian epistemology (Nyaya Shastra), which classifies every claim in an LLM response by its epistemic source (pramana): direct tool output (pratyaksha), inference (anumana), external testimony (shabda), absence (abhava), or ungrounded opinion. Our runtime generates HMAC-signed tool execution receipts that the LLM cannot forge, then cross-references claims against these receipts to detect hallucinations in real time. We evaluate on NyayaVerifyBench, a new benchmark of 1,800 agent response scenarios across four languages with injected hallucinations of six types. NabaOS detects 94.2% of fabricated tool references, 87.6% of count misstatements, and 91.3% of false absence claims, with <15ms verification overhead per response. For deep delegation (agents performing multi-step web tasks), our cross-checking protocol catches 78.4% of URL fabrications via independent re-fetching. We compare against five approaches: zkLLM (cryptographic proofs, 180s/query), TOPLOC (locality-sensitive hashing), SPEX (sampling-based proof of execution), tensor commitments, and self-consistency checking. NabaOS achieves the best cost-latency-coverage trade-off for interactive agents: 94.2% coverage at <15ms versus zkLLM's near-perfect coverage at 180,000ms. For interactive agents, practical receipt-based verification provides better cost-benefit than cryptographic proofs, and epistemic classification gives users actionable trust signals rather than binary judgments.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Medical and scientific domain agents, one of 16 directions in LLM agents and tool use. Builds on 7 of its 34 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
7 of 34 references.
References · 7
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2022Constitutional AI: Harmlessness from AI Feedbackcited by 2,950
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2024AgentHarm: A Benchmark for Measuring Harmfulness of LLM Agentscited by 406
- 2023Chain-of-Verification Reduces Hallucination in Large Language Modelscited by 317
- 2024zkLLM: Zero Knowledge Proofs for Large Language Modelscited by 51
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Notarized Agents: Receiver-Attested Confidential Receipts for AI Agent Actionscited by 0
- 2026Uncertainty Quantification for LLM Agents: A Taxonomy, an Evaluation Protocol, and an Empirical Studycited by 0
- 2026AgentKernel: The Trust-Native Agentic Operating Systemcited by 0
- 2026Coding Agents Aren't Enough! Evaluating an Enterprise Security Brain for Agentic Cloud Investigationscited by 0
- 2026Coding Agents Aren't Enough! Evaluating an Enterprise Security Brain for Agentic Cloud Investigations24 Sep 2026
- 2026Uncertainty Quantification for LLM Agents: A Taxonomy, an Evaluation Protocol, and an Empirical Study7 Sep 2026
- 2026AgentKernel: The Trust-Native Agentic Operating System29 Aug 2026
- 2026Notarized Agents: Receiver-Attested Confidential Receipts for AI Agent Actions2 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026Internal Representations as Indicators of Hallucinations in Agent Tool Selection
- 2026Closed-World Resolution Against Tool Hallucination in LLM Agents
- 2026Hallucination as Exploit: Evidence-Carrying Multimodal Agents
- 2025CausalGuard: A Smart System for Detecting and Preventing False Information in Large Language Models
- 2026Steering the Verifiability of Multimodal AI Hallucinations
- 2026MARCH: Multi-Agent Reinforced Self-Check for LLM Hallucination
- 2026Evidence-Grounded Verified Agentic Reasoning: A Path Toward Eliminating LLM Hallucination in Empirical Inference via Tool-Attested Kernel Proofs
- 2026LegalHalluLens: Typed Hallucination Auditing and Calibrated Multi-Agent Debate for Trustworthy Legal AI