mlsanityData to 14 Oct 2026

CITECHOICE: A Causal Audit of How Document Presentation Redistributes Citation Credit in Agentic Search

arXiv 2609.15164 ↗First posted 14 Sep 2026cs.CLcited by 0

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

When several retrieved sources support the same claim, an answer engine cites some but not others. We call this decision citation allocation and introduce CITECHOICE, a causal audit of authentic multi-turn agentic search. From 129 everyday-query transcripts, CITECHOICE selects 113 same-call document pairs with independently verified support for the same pre-specified fact, without observing ranks or answer outcomes; blinded human review confirms 103. It runs a hash-verified 2-by-2 replay crossing pair order with jointly generated, fidelity-checked structured and prose renderings of one target while the rest of the transcript remains fixed. Three results emerge. First, and most importantly, structured rendering concentrates citation credit rather than clearly increasing source admission. It raises target citation count by +0.50 citations per answer (95 percent CI [+0.20, +0.84]; Holm-adjusted p=.033), without increasing total citations or reducing competitor credit. The pre-specified incidence effect (whether the target is cited at all) is +4.5 percentage points and inconclusive (95 percent CI [-1.4, +10.4]; p=.168). Second, observational position differences exceed controlled reordering effects: the citation-rate gap between rank 1 and rank 5 is 42.3 percentage points, compared with +7.9 percentage points in the main replay and 0.0 percentage points held out. Third, citation evaluation has a measurable noise floor. Although the aggregate count effect repeats under fresh decoding of 30 frozen families, 15 percent of binary decisions change and decoding accounts for an estimated 45 percent of single-generation family-effect variance. Together, these findings isolate what survives control: presentation can causally redistribute visible citation credit within frozen transcripts. They do not establish reliable source admission, a pure formatting mechanism, or a general rank advantage.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 14 of its 27 references that are in the map. First posted on arXiv 14 Sep 2026.

Builds on

14 of 27 references.

References · 14

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  3. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  4. 2023Large Language Models Can Be Easily Distracted by Irrelevant Contextcited by 841
  5. 2023Enabling Large Language Models to Generate Text with Citationscited by 595
  6. 2023Evaluating Verifiability in Generative Search Enginescited by 303
  7. 2024What Evidence Do Language Models Find Convincing?cited by 75
  8. 2024Ranking Manipulation for Conversational Search Enginescited by 26
  9. 2025Do RAG Systems Really Suffer From Positional Bias?cited by 12
  10. 2026Whose Facts Win? LLM Source Preferences under Knowledge Conflictscited by 12
  11. 2026Structural Feature Engineering for Generative Engine Optimization: How Content Structure Shapes Citation Behaviorcited by 5
  12. 2026Diagnosing and Repairing Citation Failures in Generative Engine Optimizationcited by 3
2 more
  1. 2026Think Before Writing: Feature-Level Multi-Objective Optimization for Generative Citation Visibilitycited by 3
  2. 2026What Gets Cited: Competitive GEO in AI Answer Enginescited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026AtomCite: Verification and Correction of Supplied Page-Level Citations in Multi-Page Documents
  2. 2026Search Shapes Conclusions: Auditing Evidence Selection Bias in Deep Research Agents
  3. 2026Why Neighborhoods Matter: Traversal Context and Provenance in Agentic GraphRAG
  4. 2026ProvenAI: Provenance-Native Traces of Evidence in Generated Answers
  5. 2025L-MARS: Legal Multi-Agent System with Agentic Search and Citation-Faithfulness Audit
  6. 2026CUE-R: Beyond the Final Answer in Retrieval-Augmented Generation
  7. 2026Evaluating and Guarding Citation Faithfulness in Agentic Scientific Synthesis
  8. 2026Source or It Didn't Happen: A Multi-Agent Framework for Citation Hallucination Detection