mlsanityData to 7 Oct 2026

ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answering

arXiv 2210.03849 ↗First posted 7 Oct 2022cs.CLcited by 194

On the map: LLM reasoning → Reasoning for agents, planning and code

Abstract (arXiv)

With the recent advance in large pre-trained language models, researchers have achieved record performances in NLP tasks that mostly focus on language pattern matching. The community is experiencing the shift of the challenge from how to model language to the imitation of complex reasoning abilities like human beings. In this work, we investigate the application domain of finance that involves real-world, complex numerical reasoning. We propose a new large-scale dataset, ConvFinQA, aiming to study the chain of numerical reasoning in conversational question answering. Our dataset poses great challenge in modeling long-range, complex numerical reasoning paths in real-world conversations. We conduct comprehensive experiments and analyses with both the neural symbolic methods and the prompting-based methods, to provide insights into the reasoning mechanisms of these two divisions. We believe our new dataset should serve as a valuable resource to push forward the exploration of real-world, complex reasoning tasks as the next research focus. Our dataset and code is publicly available at https://github.com/czyssrs/ConvFinQA.

Key facts. Cited by 194 papers in the map (data through 7 Oct 2026). Placed in Reasoning for agents, planning and code, one of 17 directions in LLM reasoning. Builds on 22 of its 32 references that are in the map. First posted on arXiv 7 Oct 2022.

Builds on

22 of 32 references.

References · 22

  1. 2017Attention Is All You Needcited by 59,932
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2020Language Models are Few-Shot Learnerscited by 32,199
  5. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  6. 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,266
  7. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
  8. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,304
  9. 2016SQuAD: 100,000+ Questions for Machine Comprehension of Textcited by 4,115
  10. 2021Multitask Prompted Training Enables Zero-Shot Task Generalizationcited by 1,462
  11. 2019DROP: A Reading Comprehension Benchmark Requiring Discrete Reasoning Over Paragraphscited by 883
  12. 2018CoQA: A Conversational Question Answering Challengecited by 674
10 more
  1. 2019MathQA: Towards Interpretable Math Word Problem Solving with Operation-Based Formalismscited by 653
  2. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
  3. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
  4. 2018QuAC : Question Answering in Contextcited by 379
  5. 2022Language Models with Image Descriptors are Strong Few-Shot Video-Language Learnerscited by 117
  6. 2016Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervisioncited by 101
  7. 2018Complex Sequential Question Answering: Towards Learning to Converse Over Linked Question Answer Pairs with a Knowledge Graphcited by 67
  8. 2021Conversational Question Answering: A Surveycited by 31
  9. 2019Are You for Real? Detecting Identity Fraud via Dialogue Interactionscited by 8
  10. 2019A framework for anomaly detection using language modeling, and its applications to financecited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 5; 2023: 15; 2024: 48; 2025: 51; 2026: 75.

194 papers.

Sort:

By area:

  1. 2022Program of Thoughts Prompting: Disentangling Computation from Reasoning for Numerical Reasoning Taskscited by 1,057
  2. 2023BloombergGPT: A Large Language Model for Financecited by 923
  3. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
  4. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 217
  5. 2023Navigate through Enigmatic Labyrinth A Survey of Chain of Thought Reasoning: Advances, Frontiers and Futurecited by 184
  6. 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 140
  7. 2022A Survey of Deep Learning for Mathematical Reasoningcited by 124
  8. 2024Revolutionizing Finance with LLMs: An Overview of Applications and Insightscited by 88
  9. 2025Fin-R1: A Large Language Model for Financial Reasoning through Reinforcement Learningcited by 82
  10. 2024A Survey of Large Language Models in Finance (FinLLMs)cited by 77
  11. 2023Corex: Pushing the Boundaries of Complex Reasoning through Multi-Model Collaborationcited by 70
  12. 2024Demystifying Chains, Trees, and Graphs of Thoughtscited by 63
38 more
  1. 2024Instruction Pre-Training: Language Models are Supervised Multitask Learnerscited by 63
  2. 2023Are ChatGPT and GPT-4 General-Purpose Solvers for Financial Text Analytics? A Study on Several Typical Taskscited by 59
  3. 2023FinEval: A Chinese Financial Domain Knowledge Evaluation Benchmark for Large Language Modelscited by 52
  4. 2023Adapting Large Language Models to Domains via Reading Comprehensioncited by 48
  5. 2024AlphaFin: Benchmarking Financial Analysis with Retrieval-Augmented Stock-Chain Frameworkcited by 47
  6. 2024Financial Report Chunking for Effective Retrieval Augmented Generationcited by 46
  7. 2025StockBench: Can LLM Agents Trade Stocks Profitably In Real-world Markets?cited by 43
  8. 2024Number Cookbook: Number Understanding of Language Models and How to Improve Itcited by 41
  9. 2024Open-FinLLMs: Open Multimodal Large Language Models for Financial Applicationscited by 36
  10. 2023Graph Reasoning for Question Answering with Triplet Retrievalcited by 34
  11. 2024FinTral: A Family of GPT-4 Level Multimodal Financial Large Language Modelscited by 32
  12. 2025Fino1: On the Transferability of Reasoning-Enhanced LLMs and Reinforcement Learning to Financecited by 32
  13. 2024MoRA: High-Rank Updating for Parameter-Efficient Fine-Tuningcited by 31
  14. 2024AI for social science and social science of AI: A Surveycited by 29
  15. 2025PRBench: Large-Scale Expert Rubrics for Evaluating High-Stakes Professional Reasoningcited by 29
  16. 2024A Survey of Useful LLM Evaluationcited by 28
  17. 2024OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domaincited by 28
  18. 2024Evaluating LLMs' Mathematical Reasoning in Financial Document Question Answeringcited by 25
  19. 2025Demystifying Domain-adaptive Post-training for Financial LLMscited by 24
  20. 2024CABINET: Content Relevance based Noise Reduction for Table Question Answeringcited by 23
  21. 2024A Survey of Conversational Searchcited by 22
  22. 2024RAD-Bench: Evaluating Large Language Models Capabilities in Retrieval Augmented Dialoguescited by 19
  23. 2024FAMMA: A Benchmark for Financial Domain Multilingual Multimodal Question Answeringcited by 19
  24. 2024FinDVer: Explainable Claim Verification over Long and Hybrid-Content Financial Documentscited by 19
  25. 2023Can GPT models be Financial Analysts? An Evaluation of ChatGPT and GPT-4 on mock CFA Examscited by 18
  26. 2024SEC-QA: A Systematic Evaluation Corpus for Financial QAcited by 17
  27. 2025FinDER: Financial Dataset for Question Answering and Evaluating Retrieval-Augmented Generationcited by 17
  28. 2026FinCARDS: Card-Based Analyst Reranking for Financial Document Question Answeringcited by 16
  29. 2024Mixing It Up: The Cocktail Effect of Multi-Task Fine-Tuning on LLM Performance -- A Case Study in Financecited by 15
  30. 2024Domain Adaptation of Llama3-70B-Instruct through Continual Pre-Training and Model Merging: A Comprehensive Evaluationcited by 14
  31. 2025MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial Applicationcited by 14
  32. 2025FinAuditing: A Financial Taxonomy-Structured Multi-Document Benchmark for Evaluating LLMscited by 14
  33. 2024PoTable: Towards Systematic Thinking via Plan-then-Execute Stage Reasoning on Tablescited by 13
  34. 2025LiveTradeBench: Seeking Real-World Alpha with Large Language Modelscited by 13
  35. 2023CFGPT: Chinese Financial Assistant with Large Language Modelcited by 11
  36. 2024FinDABench: Benchmarking Financial Data Analysis Ability of Large Language Modelscited by 11
  37. 2024Improving Domain Adaptation through Extended-Text Reading Comprehensioncited by 10
  38. 2025MetaSynth: Meta-Prompting-Driven Agentic Scaffolds for Diverse Synthetic Data Generationcited by 10

50 most cited of 194 All 194 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Program of Thoughts for Financial Reasoning: Leveraging Dynamic In-Context Examples and Generative Retrieval
  2. 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Finance
  3. 2024Enhancing Financial Question Answering with a Multi-Agent Reflection Framework
  4. 2024Case-Based Reasoning Approach for Solving Financial Question Answering
  5. 2026Credit Cards, Confusion, Computation, and Consequences: What Can We Uncover About Language Model Reasoning?
  6. 2023BizBench: A Quantitative Reasoning Benchmark for Business and Finance
  7. 2023Beyond Classification: Financial Reasoning in State-of-the-Art Language Models
  8. 2025SciTrek: Evaluating and Improving Long-Context Numerical Reasoning over Scientific Articles