mlsanityData to 7 Oct 2026

Neuro-Symbolic Financial Reasoning via Deterministic Fact Ledgers and Adversarial Low-Latency Hallucination Detector

arXiv 2603.04663 ↗First posted 4 Mar 2026cs.LG cs.AI cs.CEcited by 2

On the map: LLM reasoning → Reasoning for agents, planning and code

also in 1 more
Abstract (arXiv)

Standard Retrieval-Augmented Generation (RAG) architectures fail in high-stakes financial domains due to two fundamental limitations: the inherent arithmetic incompetence of Large Language Models (LLMs) and the distributional semantic conflation of dense vector retrieval (e.g., mapping "Net Income" to "Net Sales" due to contextual proximity). In deterministic domains, a 99% accuracy rate yields 0% operational trust. To achieve zero-hallucination financial reasoning, we introduce the Verifiable Numerical Reasoning Agent (VeNRA). VeNRA shifts the RAG paradigm from retrieving probabilistic text to retrieving deterministic variables via a strictly typed Universal Fact Ledger (UFL). We mathematically bound this ledger using a novel Double-Lock Grounding algorithm. Coupled with deterministic Python execution, this neuro-symbolic routing compresses systemic hallucination rates to a near-zero 1.2%. Recognising that upstream parsing anomalies inevitably occur, we introduce the VeNRA Sentinel: a 3-billion parameter SLM trained to forensically audit candidate using a single-token inference budget with optional post-hoc reasoning. To train the Sentinel, we steer away from traditional hallucination datasets in favour of Adversarial Simulation, programmatically sabotaging financial records to simulate Ecological Errors. The compact Sentinel consequently outperforms 70B+ frontier models in error detection. Through Loss Dilution phenomenon in Reverse-CoT training, we present a novel Micro-Chunking loss algorithm to stabilise gradients under extreme verdict penalisation, yielding a 28x latency speedup without sacrificing forensic rigor.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 27 of its 34 references that are in the map. First posted on arXiv 4 Mar 2026.

Builds on

27 of 34 references.

References · 27

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,160
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  4. 2020Dense Passage Retrieval for Open-Domain Question Answeringcited by 3,779
  5. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,383
  6. 2021TruthfulQA: Measuring How Models Mimic Human Falsehoodscited by 2,919
  7. 2021BEIR: A Heterogenous Benchmark for Zero-shot Evaluation of Information Retrieval Modelscited by 1,225
  8. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  9. 2023Towards Understanding Sycophancy in Language Modelscited by 988
  10. 2021Are NLP Models really able to Solve Simple Math Word Problems?cited by 861
  11. 2022Red Teaming Language Models to Reduce Harms: Methods, Scaling Behaviors, and Lessons Learnedcited by 702
  12. 2022PAL: Program-aided Language Modelscited by 635
15 more
  1. 2023Textbooks Are All You Needcited by 561
  2. 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 558
  3. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
  4. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
  5. 2023HaluEval: A Large-Scale Hallucination Evaluation Benchmark for Large Language Modelscited by 329
  6. 2023A Rank Stabilization Scaling Factor for Fine-Tuning with LoRAcited by 231
  7. 2024Make Your LLM Fully Utilize the Contextcited by 118
  8. 2025Prompt Repetition Improves Non-Reasoning LLMscited by 23
  9. 2024Greenback Bears and Fiscal Hawks: Finance is a Jungle and Text Embeddings Must Adaptcited by 12
  10. 2025FinLoRA: Benchmarking LoRA Methods for Fine-Tuning LLMs on Financial Datasetscited by 11
  11. 2025HalLoc: Token-level Localization of Hallucinations for Vision Language Modelscited by 9
  12. 2025THOR: Tool-Integrated Hierarchical Optimization via RL for Mathematical Reasoningcited by 9
  13. 2025FRED: Financial Retrieval-Enhanced Detection and Editing of Hallucinations in Language Modelscited by 6
  14. 2025Metadata-Driven Retrieval-Augmented Generation for Financial Question Answeringcited by 4
  15. 2025SALSA: Single-pass Autoregressive LLM Structured Classificationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025VERAFI: Verified Agentic Financial Intelligence through Neurosymbolic Policy Generation
  2. 2025Dissecting the Ledger: Locating and Suppressing "Liar Circuits" in Financial Large Language Models
  3. 2025FinChain: A Symbolic Benchmark for Verifiable Chain-of-Thought Financial Reasoning
  4. 2026Fighting Numerical Hallucinations via Data-centric Compilation for Online Financial QA
  5. 2026Bridging the Arithmetic Gap: The Cognitive Complexity Benchmark and Financial-PoT for Robust Financial Reasoning
  6. 2026Mitigating Hallucination in Financial Retrieval-Augmented Generation via Fine-Grained Knowledge Verification
  7. 2025Enhancing Financial RAG with Agentic AI and Multi-HyDE: A Novel Approach to Knowledge Retrieval and Hallucination Reduction
  8. 2026FinGround: Detecting and Grounding Financial Hallucinations via Atomic Claim Verification