Fighting Numerical Hallucinations via Data-centric Compilation for Online Financial QA
Not on the map. Why?
Abstract (arXiv)
Large Language Models (LLMs) have significantly advanced online data services, particularly in the domain of financial question answering (FinQA). However, such systems remain susceptible to numerical reasoning hallucinations, which critically undermine reliability in high-stakes financial applications. Although retrieval-augmented generation (RAG) has been widely adopted to ground responses in external knowledge, it introduces three persistent challenges: noise sensitivity, calculation fragility, and an auditability crisis. Existing model-centric approaches, which primarily focus on optimizing either the retriever or generator in isolation, still struggle to address these issues in an integrated manner. In this work, we pioneer a data-centric paradigm and propose a novel framework, the Data-centric Reasoning Compiler (DCRC). The framework operates through three cohesive phases: (1) adversarial data construction, which synthesizes training examples with controlled noise to teach robustness; (2) multi-stage training that cultivates a Data-centric Structuring Agent (DSA) capable of explicit evidence auditing and program synthesis; and (3) a compile-and-execute inference process, where the DSA transforms user queries and retrieved documents into verifiable, executable reasoning programs. This data-driven framework ensures faithful numerical reasoning by design. We conduct extensive experiments on established offline benchmarks and further validate our framework through deployment in a real-world online financial QA system.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 22 of its 30 references that are in the map. First posted on arXiv 29 May 2026.
Builds on
22 of 30 references.
References · 22
- 2025Qwen3 Technical Reportcited by 8,195
- 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,146
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,323
- 2023Qwen Technical Reportcited by 3,273
- 2025Kimi k1.5: Scaling Reinforcement Learning with LLMscited by 1,193
- 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
- 2023RAGTruth: A Hallucination Corpus for Developing Trustworthy Retrieval-Augmented Language Modelscited by 272
- 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 194
- 2025A Survey of Large Language Model Agents for Question Answeringcited by 46
- 2023Exploring the Numerical Reasoning Capabilities of Language Models: A Comprehensive Analysis on Tabular Datacited by 33
10 more
- 2025FinanceReasoning: Benchmarking Financial Numerical Reasoning More Credible, Comprehensive and Challengingcited by 27
- 2025Exposing Numeracy Gaps: A Benchmark to Evaluate Fundamental Numerical Abilities in Large Language Modelscited by 14
- 2024Enhancing Financial Question Answering with a Multi-Agent Reflection Frameworkcited by 12
- 2025UQABench: Evaluating User Embedding for Prompting LLMs in Personalized Question Answeringcited by 9
- 2022APOLLO: An Optimized Training Approach for Long-form Numerical Reasoningcited by 8
- 2024Fine-tuning Smaller Language Models for Question Answering over Financial Documentscited by 8
- 2023Zero-Shot Question Answering over Financial Documents using Large Language Modelscited by 7
- 2025Program of Thoughts for Financial Reasoning: Leveraging Dynamic In-Context Examples and Generative Retrievalcited by 2
- 2024Enhancing Numerical Reasoning with the Guidance of Reliable Reasoning Processescited by 1
- 2026Data-Driven Function Calling Improvements in Large Language Model for Online Financial QAcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Integrating Domain Knowledge for Financial QA: A Multi-Retriever RAG Approach with LLMs
- 2026Are the Financial Reasoning from LLMs Credible? A Real World Test over Long-Horizon Statements
- 2023Data-Centric Financial Large Language Models
- 2025FinS-Pilot: A Benchmark for Online Financial RAG System
- 2023Beyond Classification: Financial Reasoning in State-of-the-Art Language Models
- 2025Evaluating Large Language Models for Financial Reasoning: A CFA-Based Benchmark Study
- 2026From Documents to Reasoning: A Validated Synthetic Data Pipeline and Semantic-Aware Fine-Tuning for Financial Numerical Reasoning
- 2025FinDER: Financial Dataset for Question Answering and Evaluating Retrieval-Augmented Generation