mlsanityData to 14 Oct 2026

BibTeX Citation Errors in Scientific Publishing Agents: Evaluation and Mitigation

arXiv 2604.03159 ↗First posted 3 Apr 2026cs.DL cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

Large language models with web search are increasingly used in scientific publishing agents, yet they produce BibTeX entries with pervasive field-level errors stemming from omission, partial corruption, substitution, and hallucination. We construct a benchmark of 931 papers across four domains and three citation tiers---popular, low-citation, and recent post-cutoff---with version-aware ground truth. Three search-enabled frontier models (GPT-5, Claude Sonnet-4.6, Gemini-3 Flash) generate approximately 23,000 field-level observations. Overall accuracy is 83.6%, but only 50.9% of entries are fully correct; accuracy drops 27.7 pp from popular to recent papers, revealing heavy reliance on parametric memory even when search is available. Co-occurrence analysis identifies two failure modes: wholesale entry substitution and isolated field error. We present clibib, an open-source tool for deterministic BibTeX retrieval, as a mitigation mechanism. Two-stage integration raises accuracy to 91.5% (+8.0 pp) and fully correct entries to 78.3%, with a 0.8% regression rate. Separating search from revision yields larger gains and lower regression than single-stage tool loops (0.8% vs. 4.8%), demonstrating that integration architecture matters independently of model/tool capability. We release clibib and an accompanying agent skill under the MIT License to improve citation accuracy in increasingly automated scientific workflows.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 3 Apr 2026.

Builds on

22 of 31 references.

References · 22

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  3. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  4. 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
  5. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
  6. 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
  7. 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
  8. 2023Do Language Models Know When They're Hallucinating References?cited by 116
  9. 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directionscited by 77
  10. 2026Autorubric: A Unifying Framework for Rubric-Based LLM Evaluation on Non-Verifiable Taskscited by 26
  11. 2026HalluCitation Matters: Revealing the Impact of Hallucinated References with 300 Hallucinated Papers in ACL Conferencescited by 19
  12. 2024Large Language Models Reflect Human Citation Patterns with a Heightened Citation Biascited by 17
10 more
  1. 2026Compound Deception in Elite Peer Review: A Failure Mode Taxonomy of 100 Fabricated Citations at NeurIPS 2025cited by 15
  2. 2026CiteAudit: You Cited It, But Did You Read It? A Benchmark for Verifying Scientific References in the LLM Eracited by 15
  3. 2026GhostCite: A Large-Scale Analysis of Citation Validity in the Age of Large Language Modelscited by 11
  4. 2025CiteGuard: Faithful Citation Attribution for LLMs via Retrieval-Augmented Validationcited by 9
  5. 2026BibAgent: An Agentic Framework for Traceable Miscitation Detection in Scientific Literaturecited by 9
  6. 2026CheckIfExist: Detecting Citation Hallucinations in the Era of AI-Generated Contentcited by 5
  7. 2025Hallucinations in Bibliographic Recommendation: Citation Frequency as a Proxy for Training Data Redundancycited by 2
  8. 2026CiteLLM: An Agentic Platform for Trustworthy Scientific Reference Discoverycited by 2
  9. 2026Structural Hallucination in Large Language Models: A Network-Based Evaluation of Knowledge Organization and Citation Integritycited by 2
  10. 2026Unmediated AI-Assisted Scholarly Citationscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025SemanticCite: Citation Verification with AI-Powered Full-Text Analysis and Evidence-Based Reasoning
  2. 2025SciRAG: Adaptive, Citation-Aware, and Outline-Guided Retrieval and Synthesis for Scientific Literature
  3. 2026Source or It Didn't Happen: A Multi-Agent Framework for Citation Hallucination Detection
  4. 2024OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs
  5. 2026AtomCite: Verification and Correction of Supplied Page-Level Citations in Multi-Page Documents
  6. 2025Citation Failure: Definition, Analysis and Efficient Mitigation
  7. 2025VERIRAG: A Post-Retrieval Auditing of Scientific Study Summaries
  8. 2026ATTRICITE: Training an Open 4B Model for Citation Recovery toward Faithful Attribution