Provenance Before Prose: Claim-Locked Reporting for Statistical Text Generation
Not on the map. Why?
Abstract (arXiv)
Large language models (LLMs) can fluently verbalize statistical evidence, yet statistical reports can still drift numerical values, invert effect directions, or restate thresholded contrasts as categorical effects. We frame these failures as a control problem: the evidence-bearing content of a scientific report should be fixed by structured statistical results rather than sampled during prose generation. We therefore use cross-run reproducibility to stress-test whether report-visible numbers and claims are bound before prose generation. Existing controls operate at the text or slot level; a deterministic hybrid template reproduces only 61.1% of report-visible numerical content across seeds because the LLM still selects which findings and numbers the template renders. We propose claim-locked reporting, a provenance-before-prose protocol that fixes the evidence source, numbers, direction, and allowed language strength of each reportable claim before the LLM writes only connective prose. Across fMRI functional-connectivity reporting and randomized controlled trial reporting on Evidence Inference 2.0, claim-locked reporting improves reproducibility over the hybrid template by 37.4 and 20.5 points, respectively. Blinded human audits support the observed direction-preservation and governance trends. In an fMRI cost analysis with DeepSeek, claim-locked reporting also yields the lowest observed token use and median generation latency.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 14 of its 26 references that are in the map. First posted on arXiv 26 Aug 2026.
Builds on
14 of 26 references.
References · 14
- 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
- 2022Survey of Hallucination in Natural Language Generationcited by 2,075
- 2022Large Language Models Encode Clinical Knowledgecited by 1,830
- 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,601
- 2023FActScore: Fine-grained Atomic Evaluation of Factual Precision in Long Form Text Generationcited by 1,282
- 2023Towards Generalist Biomedical AIcited by 289
- 2023Adapted Large Language Models Can Outperform Medical Experts in Clinical Text Summarizationcited by 246
- 2017Challenges in Data-to-Document Generationcited by 226
- 2017Survey of the State of the Art in Natural Language Generation: Core tasks, applications and evaluationcited by 206
- 2023Efficient Guided Generation for Large Language Modelscited by 200
- 2024MAIRA-2: Grounded Radiology Report Generationcited by 145
- 2022Prompting Is Programming: A Query Language for Large Language Modelscited by 110
2 more
- 2018Data-to-Text Generation with Content Selection and Planningcited by 106
- 2020Evidence Inference 2.0: More Data, Better Modelscited by 40
Built on by
Not cited yet.