mlsanityData to 14 Oct 2026

Source or It Didn't Happen: A Multi-Agent Framework for Citation Hallucination Detection

arXiv 2605.08583 ↗First posted 9 May 2026cs.CLcited by 3

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

Large language models are increasingly used in scientific writing, yet they can fabricate citation-shaped references that appear plausible but fail bibliographic verification. Existing detectors often reduce verification to binary found/not-found decisions and rely on brittle parsing or incomplete retrieval, offering little field-level signal to auditors. We reframe citation hallucination detection as taxonomy-aligned field-level adjudication and introduce a 12-code taxonomy spanning Real, Potential, and Hallucinated citations. Based on this taxonomy, we build CiteTracer, a cascading multi-agent detector that extracts structured citations from PDF and BibTeX, retrieves evidence through cache lookup, URL fetch, scholar connectors, and web search, applies deterministic field matching, and routes ambiguous cases to class-specialist judgers. We release a benchmark of 2,450 synthetic citations built from real seeds with controlled LLM mutations, paired with 957 real-world fabricated citations drawn from desk-rejected submissions at ICLR 2026 and an anonymous conference. CiteTracer reaches 97.1% accuracy on the synthetic benchmark, with class-level F1 scores of 97.0, 95.8, and 98.5 for Real, Potential, and Hallucinated, respectively, and detects 97.1% of fabrications on the real-world set without abstaining. Code: https://github.com/aaFrostnova/CiteTracer.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 14 of its 30 references that are in the map. First posted on arXiv 9 May 2026.

Builds on

14 of 30 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025AutoData: A Multi-Agent System for Open Web Data Collection21 May
  2. 2024Web Retrieval Agents for Evidence-Based Misinformation Detection15 Aug

Other references · 12

  1. 2025Qwen3-VL Technical Reportcited by 2,793
  2. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  3. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  4. 2025Mem0: Building Production-Ready AI Agents with Scalable Long-Term Memorycited by 779
  5. 2024A Comprehensive Survey of Hallucination Mitigation Techniques in Large Language Modelscited by 269
  6. 2026DeepSeek-OCR 2: Visual Causal Flowcited by 74
  7. 2026HalluCitation Matters: Revealing the Impact of Hallucinated References with 300 Hallucinated Papers in ACL Conferencescited by 19
  8. 2026CiteAudit: You Cited It, But Did You Read It? A Benchmark for Verifying Scientific References in the LLM Eracited by 15
  9. 2015A review of the literature on citation impact indicatorscited by 14
  10. 2025Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Modelscited by 13
  11. 2014Learning Soft Linear Constraints with Application to Citation Field Extractioncited by 8
  12. 2025AI-Powered Citation Auditing: A Zero-Assumption Protocol for Systematic Reference Verification in Academic Researchcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Detecting and Correcting Reference Hallucinations in Commercial LLMs and Deep Research Agents
  2. 2026Who Checks the Citations? Benchmarking Legal Hallucination Detection
  3. 2026BibAgent: An Agentic Framework for Traceable Miscitation Detection in Scientific Literature
  4. 2026FACTUM: Mechanistic Detection of Citation Hallucination in Long-Form RAG
  5. 2024Abstention vs. Hallucination: Benchmarking LLM Source Attribution for Scientific Citations
  6. 2026When Citations Mislead? A Claim-Level Benchmark for Legal Hallucination Detection
  7. 2024Towards Detecting LLMs Hallucination via Markov Chain-based Multi-agent Debate Framework
  8. 2026ReCite: Agentic Reasoning for Faithful Citation