BibTeX Citation Errors in Scientific Publishing Agents: Evaluation and Mitigation
Not on the map. Why?
Abstract (arXiv)
Large language models with web search are increasingly used in scientific publishing agents, yet they produce BibTeX entries with pervasive field-level errors stemming from omission, partial corruption, substitution, and hallucination. We construct a benchmark of 931 papers across four domains and three citation tiers---popular, low-citation, and recent post-cutoff---with version-aware ground truth. Three search-enabled frontier models (GPT-5, Claude Sonnet-4.6, Gemini-3 Flash) generate approximately 23,000 field-level observations. Overall accuracy is 83.6%, but only 50.9% of entries are fully correct; accuracy drops 27.7 pp from popular to recent papers, revealing heavy reliance on parametric memory even when search is available. Co-occurrence analysis identifies two failure modes: wholesale entry substitution and isolated field error. We present clibib, an open-source tool for deterministic BibTeX retrieval, as a mitigation mechanism. Two-stage integration raises accuracy to 91.5% (+8.0 pp) and fully correct entries to 78.3%, with a 0.8% regression rate. Separating search from revision yields larger gains and lower regression than single-stage tool loops (0.8% vs. 4.8%), demonstrating that integration architecture matters independently of model/tool capability. We release clibib and an accompanying agent skill under the MIT License to improve citation accuracy in increasingly automated scientific workflows.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 22 of its 31 references that are in the map. First posted on arXiv 3 Apr 2026.
Builds on
22 of 31 references.
References · 22
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2024SWE-agent: Agent-Computer Interfaces Enable Automated Software Engineeringcited by 1,737
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2025Agent Laboratory: Using LLM Agents as Research Assistantscited by 425
- 2023FacTool: Factuality Detection in Generative AI -- A Tool Augmented Framework for Multi-Task and Multi-Domain Scenarioscited by 251
- 2023Do Language Models Know When They're Hallucinating References?cited by 116
- 2025Agentic AI for Scientific Discovery: A Survey of Progress, Challenges, and Future Directionscited by 77
- 2026Autorubric: A Unifying Framework for Rubric-Based LLM Evaluation on Non-Verifiable Taskscited by 26
- 2026HalluCitation Matters: Revealing the Impact of Hallucinated References with 300 Hallucinated Papers in ACL Conferencescited by 19
- 2024Large Language Models Reflect Human Citation Patterns with a Heightened Citation Biascited by 17
10 more
- 2026Compound Deception in Elite Peer Review: A Failure Mode Taxonomy of 100 Fabricated Citations at NeurIPS 2025cited by 15
- 2026CiteAudit: You Cited It, But Did You Read It? A Benchmark for Verifying Scientific References in the LLM Eracited by 15
- 2026GhostCite: A Large-Scale Analysis of Citation Validity in the Age of Large Language Modelscited by 11
- 2025CiteGuard: Faithful Citation Attribution for LLMs via Retrieval-Augmented Validationcited by 9
- 2026BibAgent: An Agentic Framework for Traceable Miscitation Detection in Scientific Literaturecited by 9
- 2026CheckIfExist: Detecting Citation Hallucinations in the Era of AI-Generated Contentcited by 5
- 2025Hallucinations in Bibliographic Recommendation: Citation Frequency as a Proxy for Training Data Redundancycited by 2
- 2026CiteLLM: An Agentic Platform for Trustworthy Scientific Reference Discoverycited by 2
- 2026Structural Hallucination in Large Language Models: A Network-Based Evaluation of Knowledge Organization and Citation Integritycited by 2
- 2026Unmediated AI-Assisted Scholarly Citationscited by 1
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025SemanticCite: Citation Verification with AI-Powered Full-Text Analysis and Evidence-Based Reasoning
- 2025SciRAG: Adaptive, Citation-Aware, and Outline-Guided Retrieval and Synthesis for Scientific Literature
- 2026Source or It Didn't Happen: A Multi-Agent Framework for Citation Hallucination Detection
- 2024OpenScholar: Synthesizing Scientific Literature with Retrieval-augmented LMs
- 2026AtomCite: Verification and Correction of Supplied Page-Level Citations in Multi-Page Documents
- 2025Citation Failure: Definition, Analysis and Efficient Mitigation
- 2025VERIRAG: A Post-Retrieval Auditing of Scientific Study Summaries
- 2026ATTRICITE: Training an Open 4B Model for Citation Recovery toward Faithful Attribution