mlsanityData to 7 Oct 2026

Beyond Document Grounding: Span-Level Hallucination Detection over Code, Tool Output, and Documents

arXiv 2607.00895 ↗First posted 1 Jul 2026cs.CLcited by 1

On the map: Retrieval-augmented generation → Hallucination detection in RAG

Abstract (arXiv)

Hallucination detection for retrieval-augmented generation (RAG) is usually evaluated on natural-language document evidence. However, grounded generation systems increasingly rely on structured inputs: source code, developer-tool output, markdown documents, tables, and repository metadata. We introduce a unified benchmark for span-level hallucination detection over code, tool output, structured documents, and existing natural-language RAG datasets. The benchmark is built by starting from grounded correct answers, injecting localized hallucinations with exact character labels, and validating the code test split with evidence-based review. Our fine-tuned Qwen3.5-2B detector reaches 0.689 span-F1 on the unified test set and 0.60 on the code-agent source, where it substantially outperforms LettuceDetect-large (0.17) and the strongest zero-shot LLM judges we evaluated (at most 0.22). The same model remains competitive on established natural-language benchmarks, with 81.8 RAGTruth example-F1 and 0.724 English PsiloQA IoU.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Hallucination detection in RAG, one of 15 directions in Retrieval-augmented generation. Builds on 16 of its 26 references that are in the map. First posted on arXiv 1 Jul 2026.

Builds on

16 of 26 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025LettuceDetect: A Hallucination Detection Framework for RAG Applications24 Feb
  2. 2024Lynx: An Open Source Hallucination Evaluation Model11 Jul
  3. 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Models31 Dec

Other references · 13

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  3. 2024MiniCheck: Efficient Fact-Checking of LLMs on Grounding Documentscited by 251
  4. 2024Fine-grained Hallucination Detection and Editing for Language Modelscited by 146
  5. 2024CodeHalu: Investigating Code Hallucinations in LLMs via Execution-based Verificationcited by 32
  6. 2025SemEval-2025 Task 3: Mu-SHROOM, the Multilingual Shared Task on Hallucinations and Related Observable Overgeneration Mistakescited by 27
  7. 2024CodeMirage: Hallucinations in Code Generated by Large Language Modelscited by 23
  8. 2024Collu-Bench: A Benchmark for Predicting Language Model Hallucinations in Codecited by 13
  9. 2025When Models Lie, We Learn: Multilingual Span-Level Hallucination Detection with PsiloQAcited by 13
  10. 2025Learning to Reason for Hallucination Span Detectioncited by 5
  11. 2026Squeez: Task-Conditioned Tool-Output Pruning for Coding Agentscited by 2
  12. 2026Delulu: A Verified Multi-Lingual Benchmark for Code Hallucination Detection in Fill-in-the-Middle Taskscited by 1
1 more
  1. 2026ACL-Verbatim: hallucination-free question answering for researchcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2025HalluSearch at SemEval-2025 Task 3: A Search-Enhanced RAG Pipeline for Hallucination Detection
  2. 2025Bi'an: A Bilingual Benchmark and Model for Hallucination Detection in Retrieval-Augmented Generation
  3. 2025HalluMix: A Task-Agnostic, Multi-Domain Benchmark for Real-World Hallucination Detection
  4. 2025LUMINA: Detecting Hallucinations in RAG System with Context-Knowledge Signals
  5. 2026CORTEX: Token-Level Hallucination Detection in RAG via Comparative Internal Representations
  6. 2025MetaRAG: Metamorphic Testing for Hallucination Detection in RAG Systems
  7. 2025ORION Grounded in Context: Retrieval-Based Method for Hallucination Detection
  8. 2026RAGognizer: Hallucination-Aware Fine-Tuning via Detection Head Integration