mlsanityData to 7 Oct 2026

FinQA: A Dataset of Numerical Reasoning over Financial Data

arXiv 2109.00122 ↗First posted 1 Sep 2021cs.CLcited by 552

Not on the map. Why?

Cited by 87 in LLM reasoning, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

The sheer volume of financial statements makes it difficult for humans to access and analyze a business's financials. Robust numerical reasoning likewise faces unique challenges in this domain. In this work, we focus on answering deep questions over financial data, aiming to automate the analysis of a large corpus of financial documents. In contrast to existing tasks on general domain, the finance domain includes complex numerical reasoning and understanding of heterogeneous representations. To facilitate analytical progress, we propose a new large-scale dataset, FinQA, with Question-Answering pairs over Financial reports, written by financial experts. We also annotate the gold reasoning programs to ensure full explainability. We further introduce baselines and conduct comprehensive experiments in our dataset. The results demonstrate that popular, large, pre-trained models fall far short of expert humans in acquiring finance knowledge and in complex multi-step numerical reasoning on that knowledge. Our dataset -- the first of its kind -- should therefore enable significant, new community research into complex application domains. The dataset and code are publicly availableurlhttps://github.com/czyssrs/FinQA.

Key facts. Cited by 552 papers in the map (data through 7 Oct 2026). Builds on 19 of its 44 references that are in the map. First posted on arXiv 1 Sep 2021.

Builds on

19 of 44 references.

References · 19

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  3. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  4. 2018HotpotQA: A Dataset for Diverse, Explainable Multi-hop Question Answeringcited by 3,686
  5. 2020Longformer: The Long-Document Transformercited by 3,362
  6. 2018Know What You Don't Know: Unanswerable Questions for SQuADcited by 1,538
  7. 2018Spider: A Large-Scale Human-Labeled Dataset for Complex and Cross-Domain Semantic Parsing and Text-to-SQL Taskcited by 1,120
  8. 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
  9. 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 653
  10. 2015Compositional Semantic Parsing on Semi-Structured Tablescited by 509
  11. 2019TabFact: A Large-scale Dataset for Table-based Fact Verificationcited by 425
  12. 2018The Web as a Knowledge-base for Answering Complex Questionscited by 409
7 more
  1. 2019FinBERT: Financial Sentiment Analysis with Pre-trained Language Modelscited by 378
  2. 2020HybridQA: A Dataset of Multi-Hop Question Answering over Tabular and Textual Datacited by 263
  3. 2020FinBERT: A Pretrained Language Model for Financial Communicationscited by 161
  4. 2020Global Table Extractor (GTE): A Framework for Joint Table Identification and Cell Structure Recognition Using Visual Contextcited by 146
  5. 2019A BERT Baseline for the Natural Questionscited by 33
  6. 2019Are You for Real? Detecting Identity Fraud via Dialogue Interactionscited by 8
  7. 2019A framework for anomaly detection using language modeling, and its applications to financecited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 2; 2022: 31; 2023: 48; 2024: 91; 2025: 162; 2026: 218.

552 papers.

Sort:

By area:

  1. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  2. 2023BloombergGPT: A Large Language Model for Financecited by 923
  3. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  4. 2023Can LLM Already Serve as A Database Interface? A BIg Bench for Large-Scale Database Grounded Text-to-SQLscited by 667
  5. 2022Dynamic Prompt Learning via Policy Gradient for Semi-structured Mathematical Reasoningcited by 347
  6. 2024What matters when building vision-language models?cited by 321
  7. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
  8. 2023FinGPT: Open-Source Financial Large Language Modelscited by 244
  9. 2023Automatically Correcting Large Language Models: Surveying the landscape of diverse self-correction strategiescited by 236
  10. 2024HelpSteer2: Open-source dataset for training top-performing reward modelscited by 232
  11. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 217
  12. 2023FLASK: Fine-grained Language Model Evaluation based on Alignment Skill Setscited by 198
38 more
  1. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 194
  2. 2023TheoremQA: A Theorem-driven Question Answering datasetcited by 189
  3. 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
  4. 2024Building and better understanding vision-language models: insights and future directionscited by 169
  5. 2024Nemotron-4 340B Technical Reportcited by 143
  6. 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 140
  7. 2024TableBench: A Comprehensive and Complex Benchmark for Table Question Answeringcited by 127
  8. 2024MAmmoTH-VL: Eliciting Multimodal Reasoning with Instruction Tuning at Scalecited by 125
  9. 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
  10. 2022MultiHiertt: Numerical Reasoning over Multi Hierarchical Tabular and Textual Datacited by 120
  11. 2022Large Language Models are few(1)-shot Table Reasonerscited by 116
  12. 2024RAGBench: Explainable Benchmark for Retrieval-Augmented Generation Systemscited by 115
  13. 2024HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extractioncited by 92
  14. 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 88
  15. 2024A Survey of Large Language Models for Financial Applications: Progress, Prospects and Challengescited by 86
  16. 2022Towards Complex Document Understanding By Discrete Reasoningcited by 82
  17. 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learningcited by 82
  18. 2023A Survey of GPT-3 Family Large Language Models Including ChatGPT and GPT-4cited by 81
  19. 2023InvestLM: A Large Language Model for Investment using Financial Domain Instruction Tuningcited by 80
  20. 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 77
  21. 2024MM1.5: Methods, Analysis & Insights from Multimodal LLM Fine-tuningcited by 75
  22. 2025Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain Perspectivecited by 75
  23. 2023Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaborationcited by 70
  24. 2022ScreenQA: Large-Scale Question-Answer Pairs over Mobile App Screenshotscited by 65
  25. 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
  26. 2024Are LLMs Capable of Data-based Statistical and Causal Reasoning? Benchmarking Advanced Quantitative Reasoning with Datacited by 61
  27. 2023Are ChatGPT and GPT-4 General-Purpose Solvers for Financial Text Analytics? A Study on Several Typical Taskscited by 59
  28. 2024DocFinQA: A Long-Context Financial Reasoning Datasetcited by 59
  29. 2024FinTextQA: A Dataset for Long-form Financial Question Answeringcited by 54
  30. 2023FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Modelscited by 52
  31. 2025FineVision: Open Data Is All You Needcited by 51
  32. 2025DeepAnalyze: Agentic Large Language Models for Autonomous Data Sciencecited by 49
  33. 2024Financial Report Chunking for Effective Retrieval Augmented Generationcited by 46
  34. 2024A Survey of Prompt Engineering Methods in Large Language Models for Different NLP Taskscited by 46
  35. 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Financecited by 45
  36. 2023DocMath-Eval: Evaluating Math Reasoning Capabilities of LLMs in Understanding Long and Specialized Documentscited by 45
  37. 2025StockBench: Can LLM Agents Trade Stocks Profitably In Real-world Markets?cited by 43
  38. 2022Table Pre-training: A Survey on Model Architectures, Pre-training Objectives, and Downstream Taskscited by 42

50 most cited of 552 All 552 (JSON)