mlsanityData to 14 Oct 2026

Proof-Carrying Numbers (PCN): A Protocol for Trustworthy Numeric Answers from LLMs via Claim Verification

arXiv 2509.06902 ↗First posted 8 Sep 2025cs.CL cs.CR cs.DBcited by 0

Not on the map. Why?

Abstract (arXiv)

Large Language Models (LLMs) as stochastic systems may generate numbers that deviate from available data, a failure known as numeric hallucination. Existing safeguards -- retrieval-augmented generation, citations, and uncertainty estimation -- improve transparency but cannot guarantee fidelity: fabricated or misquoted values may still be displayed as if correct. We propose Proof-Carrying Numbers (PCN), a presentation-layer protocol that enforces numeric fidelity through mechanical verification. Under PCN, numeric spans are emitted as claim-bound tokens tied to structured claims, and a verifier checks each token under a declared policy (e.g., exact equality, rounding, aliases, or tolerance with qualifiers). Crucially, PCN places verification in the renderer, not the model: only claim-checked numbers are marked as verified, and all others default to unverified. This separation prevents spoofing and guarantees fail-closed behavior. We formalize PCN and prove soundness, completeness under honest tokens, fail-closed behavior, and monotonicity under policy refinement. PCN is lightweight and model-agnostic, integrates seamlessly into existing applications, and can be extended with cryptographic commitments. By enforcing verification as a mandatory step before display, PCN establishes a simple contract for numerically sensitive settings: trust is earned only by proof, while the absence of a mark communicates uncertainty.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 26 references that are in the map. First posted on arXiv 8 Sep 2025.

Builds on

18 of 26 references.

References · 18

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2022Survey of Hallucination in Natural Language Generationcited by 2,075
  3. 2022Language Models (Mostly) Know What They Knowcited by 1,856
  4. 2018FEVER: a large-scale dataset for Fact Extraction and VERificationcited by 1,375
  5. 2023SelfCheckGPT: Zero-Resource Black-Box Hallucination Detection for Generative Large Language Modelscited by 810
  6. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 428
  7. 2024Hallucination is Inevitable: An Innate Limitation of Large Language Modelscited by 332
  8. 2025Why Language Models Hallucinatecited by 220
  9. 2023Grammar-Constrained Decoding for Structured NLP Tasks without Finetuningcited by 197
  10. 2021FEVEROUS: Fact Extraction and VERification Over Unstructured and Structured informationcited by 167
  11. 2024ClashEval: Quantifying the tug-of-war between an LLM's internal prior and external evidencecited by 113
  12. 2022SciFact-Open: Towards open-domain scientific claim verificationcited by 94
6 more
  1. 2024LongCite: Enabling LLMs to Generate Fine-grained Citations in Long-context QAcited by 81
  2. 2024LLMs Will Always Hallucinate, and We Need to Live With Thiscited by 78
  3. 2023Deficiency of Large Language Models in Finance: An Empirical Examination of Hallucinationcited by 41
  4. 2024AttributionBench: How Hard is Automatic Attribution Evaluation?cited by 26
  5. 2023Towards Verifiable Text Generation with Symbolic Referencescited by 13
  6. 2025Attribution, Citation, and Quotation: A Survey of Evidence-based Text Generation with Large Language Modelscited by 7

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025SynClaimEval: A Framework for Evaluating the Utility of Synthetic Data in Long-Context Claim Verification
  2. 2025Think Right, Not More: Test-Time Scaling for Numerical Claim Verification
  3. 2026Proof-Carrying Certificates for LLM Pipelines: A Trust-Boundary Architecture
  4. 2026Mask-Proof: An LLM-based Automated Data Curation Pipeline on Mathematical Proofs
  5. 2026s2n-bignum-bench: A practical benchmark for evaluating low-level code reasoning of LLMs
  6. 2026Theoria: Rewrite-Acceptability Verification over Informal Reasoning States
  7. 2025Safe: Enhancing Mathematical Reasoning in Large Language Models via Retrospective Step-aware Formal Verification
  8. 2026Trust but Verify: Prover-Verifier Deliberation for Selective LLM Prediction