ATTRICITE: Training an Open 4B Model for Citation Recovery toward Faithful Attribution
Not on the map. Why?
Abstract (arXiv)
Faithful citation attribution begins with identifying the intended source for a scientific claim. We study this source-identification capability through citation recovery: recovering the paper cited by the original author from a citation-bearing passage. Our evaluation adopts the published author's citation as an observable human attribution signal and uses target recovery as a proxy for progress toward faithful attribution. We introduce ATTRICITE, an open 4B-parameter model trained for tool-using citation recovery within the CiteGuard retrieval environment, together with CITEALIGN, a 7,607-instance computer-science dataset drawn from recent scientific literature. For controlled evaluation, we construct a 709-instance benchmark subset of CITEALIGN, comprising 410 development instances from 2024 publications and 299 temporally held-out test instances from 2025 publications. Across three runs at an inference temperature of 0.7, GRPO fine-tuning improves Qwen3-4B from 49.4%±1.5% to 59.8%±0.2% target-match accuracy, a gain of 10.4 percentage points. Despite using only 4B parameters, ATTRICITE outperforms gpt-oss-20b and comes within 3.9 points of GPT-5.4-mini, while Gemma 4 31B IT achieves the strongest overall performance at 72.0%±1.0%. We release the model and collection pipeline https://github.com/KathCYM/AttriCite to support reproducible research on citation recovery toward faithful attribution in a continually evolving scientific literature.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 31 references that are in the map. First posted on arXiv 13 Sep 2026.
Builds on
24 of 31 references.
References · 24
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,072
- 2022Survey of Hallucination in Natural Language Generationcited by 2,056
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
- 2025Search-R1: Training LLMs to Reason and Leverage Search Engines with Reinforcement Learningcited by 1,371
- 2023Enabling Large Language Models to Generate Text with Citationscited by 584
- 2020Fact or Fiction: Verifying Scientific Claimscited by 546
- 2020SPECTER: Document-level Representation Learning using Citation-informed Transformerscited by 426
- 2025R1-Searcher: Incentivizing the Search Capability in LLMs via Reinforcement Learningcited by 322
- 2024Assisting in Writing Wikipedia-like Articles From Scratch with Large Language Modelscited by 150
- 2024Mapping the Increasing Use of LLMs in Scientific Paperscited by 112
- 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
12 more
- 2022Neighborhood Contrastive Learning for Scientific Document Representations with Citation Embeddingscited by 75
- 2014Growth rates of modern science: A bibliometric analysis based on the number of publications and cited referencescited by 63
- 2024CiteME: Can Language Models Accurately Cite Scientific Claims?cited by 45
- 2018Content-Based Citation Recommendationcited by 43
- 2026Scientific production in the era of Large Language Modelscited by 30
- 2026HalluCitation Matters: Revealing the Impact of Hallucinated References with 300 Hallucinated Papers in ACL Conferencescited by 18
- 2026CiteAudit: You Cited It, But Did You Read It? A Benchmark for Verifying Scientific References in the LLM Eracited by 14
- 2026Cited but Not Verified: Parsing and Evaluating Source Attribution in LLM Deep Research Agentscited by 10
- 2025CiteGuard: Faithful Citation Attribution for LLMs via Retrieval-Augmented Validationcited by 9
- 2024CiteBART: Learning to Generate Citations for Local Citation Recommendationcited by 6
- 2026What Should I Cite? A RAG Benchmark for Academic Citation Predictioncited by 4
- 2024ILCiteR: Evidence-grounded Interpretable Local Citation Recommendationcited by 3
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025SemanticCite: Citation Verification with AI-Powered Full-Text Analysis and Evidence-Based Reasoning
- 2026The Attribution-Compression Frontier in Retrieval-Augmented Generation
- 2024Abstention vs. Hallucination: Benchmarking LLM Source Attribution for Scientific Citations
- 2026RefVerifier: Semi-Automated Reference Claim Verification for Scientific Manuscripts ↗
- 2026AtomCite: Verification and Correction of Supplied Page-Level Citations in Multi-Page Documents
- 2026CitePrism: Human-in-the-Loop AI for Citation Auditing and Editorial Integrity
- 2024A Comparative Analysis of Faithfulness Metrics and Humans in Citation Evaluation
- 2026ReCite: Agentic Reasoning for Faithful Citation