mlsanityData to 14 Oct 2026

FinTextQA: A Dataset for Long-form Financial Question Answering

arXiv 2405.09980 ↗First posted 16 May 2024cs.CL cs.AIcited by 54

Not on the map. Why?

Abstract (arXiv)

Accurate evaluation of financial question answering (QA) systems necessitates a comprehensive dataset encompassing diverse question types and contexts. However, current financial QA datasets lack scope diversity and question complexity. This work introduces FinTextQA, a novel dataset for long-form question answering (LFQA) in finance. FinTextQA comprises 1,262 high-quality, source-attributed QA pairs extracted and selected from finance textbooks and government agency websites.Moreover, we developed a Retrieval-Augmented Generation (RAG)-based LFQA system, comprising an embedder, retriever, reranker, and generator. A multi-faceted evaluation approach, including human ranking, automatic metrics, and GPT-4 scoring, was employed to benchmark the performance of different LFQA system configurations under heightened noisy conditions. The results indicate that: (1) Among all compared generators, Baichuan2-7B competes closely with GPT-3.5-turbo in accuracy score; (2) The most effective system configuration on our dataset involved setting the embedder, retriever, reranker, and generator as Ada2, Automated Merged Retrieval, Bge-Reranker-Base, and Baichuan2-7B, respectively; (3) models are less susceptible to noise after the length of contexts reaching a specific threshold.

Key facts. Cited by 54 papers in the map (data through 14 Oct 2026). Builds on 27 of its 54 references that are in the map. First posted on arXiv 16 May 2024.

Builds on

27 of 54 references.

References · 27

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  2. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  3. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  4. 2023Qwen Technical Reportcited by 3,344
  5. 2023Retrieval-Augmented Generation for Large Language Models: A Surveycited by 2,212
  6. 2020REALM: Retrieval-Augmented Language Model Pre-Trainingcited by 2,141
  7. 2022GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformerscited by 1,919
  8. 2020MPNet: Masked and Permuted Pre-training for Language Understandingcited by 981
  9. 2023Towards General Text Embeddings with Multi-stage Contrastive Learningcited by 723
  10. 2023Baichuan 2: Open Large-scale Language Modelscited by 670
  11. 2019ELI5: Long Form Question Answeringcited by 575
  12. 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 575
15 more
  1. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  2. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
  3. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
  4. 2020The Computational Limits of Deep Learningcited by 193
  5. 2023SOLAR 10.7B: Scaling Large Language Models with Simple yet Effective Depth Up-Scalingcited by 172
  6. 2023Lift Yourself Up: Retrieval-augmented Text Generation with Self Memorycited by 103
  7. 2023WebCPM: Interactive Web Search for Chinese Long-form Question Answeringcited by 93
  8. 2023Qilin-Med-VL: Towards Chinese Large Vision-Language Model for General Healthcarecited by 62
  9. 2023AI-Generated Content (AIGC): A Surveycited by 59
  10. 2021On Pursuit of Designing Multi-modal Transformer for Video Groundingcited by 54
  11. 2023Evaluation Metrics in the Era of GPT-4: Reliably Evaluating Large Language Models on Sequence to Sequence Taskscited by 53
  12. 2023Evaluating Instruction-Tuned Large Language Models on Code Comprehension and Generationcited by 50
  13. 2022LocVTP: Video-Text Pre-training for Temporal Localizationcited by 44
  14. 2023Foundation Model-oriented Robustness: Robust Image Model Evaluation with Pretrained Modelscited by 6
  15. 2023PreWoMe: Exploiting Presuppositions as Working Memory for Long Form Question Answeringcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 3; 2025: 32; 2026: 19.

54 papers.

Sort:

By area:

  1. 2024HybridRAG: Integrating Knowledge Graphs and Vector Retrieval Augmented Generation for Efficient Information Extractioncited by 93
  2. 2025Time-MQA: Time Series Multi-Task Question Answering with Context Enhancementcited by 82
  3. 2025No Free Labels: Limitations of LLM-as-a-Judge Without Human Groundingcited by 54
  4. 2025FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluationcited by 30
  5. 2024OmniEval: An Omnidirectional and Automatic RAG Evaluation Benchmark in Financial Domaincited by 29
  6. 2025Time Travel is Cheating: Going Live with DeepFund for Real-Time Fund Investment Benchmarkingcited by 21
  7. 2025FinDER: Financial Dataset for Question Answering and Evaluating Retrieval-Augmented Generationcited by 17
  8. 2025FactCG: Enhancing Fact Checkers with Graph-Based Multi-Hop Datacited by 14
  9. 2025It's High Time: A Survey of Temporal Question Answeringcited by 14
  10. 2025WixQA: A Multi-Dataset Benchmark for Enterprise Retrieval-Augmented Generationcited by 10
  11. 2025Towards Temporal-Aware Multi-Modal Retrieval Augmented Generation in Financecited by 8
  12. 2025FinTrust: A Comprehensive Benchmark of Trustworthiness Evaluation in Finance Domaincited by 8
38 more
  1. 2024INS-MMBench: A Comprehensive Benchmark for Evaluating LVLMs' Performance in Insurancecited by 7
  2. 2026QuantEval: A Benchmark for Financial Quantitative Tasks in Large Language Modelscited by 7
  3. 2026BigFinanceBench: A Workflow-Grounded Benchmark for Financial-Research Agentscited by 7
  4. 2025SustainableQA: A Comprehensive Question Answering Dataset for Corporate Sustainability and EU Taxonomy Reportingcited by 5
  5. 2026FinReporting: An Agentic Workflow for Localized Reporting of Cross-Jurisdiction Financial Disclosurescited by 5
  6. 2025Bridging Language Models and Financial Analysiscited by 4
  7. 2025Metadata-Driven Retrieval-Augmented Generation for Financial Question Answeringcited by 4
  8. 2026FinRetrieval: A Benchmark for Financial Data Retrieval by AI Agentscited by 4
  9. 2025Extract, Match, and Score: An Evaluation Paradigm for Long Question-context-answer Triplets in Financial Analysiscited by 3
  10. 2025T2-RAGBench: Text-and-Table Benchmark for Evaluating Retrieval-Augmented Generationcited by 3
  11. 2026FinSafetyBench: Evaluating LLM Safety in Real-World Financial Scenarioscited by 3
  12. 2025FinSphere, a Real-Time Stock Analysis Agent Powered by Instruction-Tuned LLMs and Domain Toolscited by 2
  13. 2025LiveLongBench: Tackling Long-Context Understanding for Spoken Texts from Live Streamscited by 2
  14. 2025M3FinMeeting: A Multilingual, Multi-Sector, and Multi-Task Financial Meeting Understanding Evaluation Datasetcited by 2
  15. 2025How Accurate Are LLMs at Multi-Question Answering on Conversational Transcripts?cited by 2
  16. 2025KnowMT-Bench: Benchmarking Knowledge-Intensive Long-Form Question Answering in Multi-Turn Dialoguescited by 2
  17. 2026AlphaForgeBench: Benchmarking End-to-End Trading Strategy Design with Large Language Modelscited by 2
  18. 2026Agentic Retrieval-Augmented Generation for Financial Document Question Answeringcited by 2
  19. 2025Exploring the Reliability of Self-explanation and its Relationship with Classification in Language Model-driven Financial Analysiscited by 1
  20. 2025Enhancing Document-Level Question Answering via Multi-Hop Retrieval-Augmented Generation with LLaMA 3cited by 1
  21. 2025Read the Docs Before Rewriting: Equip Rewriter with Domain Knowledge via Continual Pre-trainingcited by 1
  22. 2025DeKeyNLU: Enhancing Natural Language to SQL Generation through Task Decomposition and Keyword Extractioncited by 1
  23. 2025Fin-Ally: Pioneering the Development of an Advanced, Commonsense-Embedded Conversational AI for Money Matterscited by 1
  24. 2025Domain-Specific Data Generation Framework for RAG Adaptationcited by 1
  25. 2026AdversaRiskQA: An Adversarial Factuality Benchmark for High-Risk Domainscited by 1
  26. 2026Data-Driven Function Calling Improvements in Large Language Model for Online Financial QAcited by 1
  27. 2026DiagnosticIQ: A Benchmark for LLM-Based Industrial Maintenance Action Recommendation from Symbolic Rulescited by 1
  28. 2026From Statute to Control Flow: Span-Grounded Deontic Trees for Defeasible Scope Parsingcited by 1
  29. 2026FinDeepIndicator: Benchmarking Deep Research Agents in End-to-End Financial Indicator Constructioncited by 1
  30. 2026FinRank: An Evidence-Grounded Benchmark for Financial Question Answering and Retrieval over SEC Filingscited by 1
  31. 2025Towards Competent AI for Fundamental Analysis in Finance: A Benchmark Dataset and Evaluationcited by 0
  32. 2025FinCPRG: A Bidirectional Generation Pipeline for Hierarchical Queries and Rich Relevance in Financial Chinese Passage Retrievalcited by 0
  33. 2025Interpreting Fedspeak with Confidence: A LLM-Based Uncertainty-Aware Framework Guided by Monetary Policy Transmission Pathscited by 0
  34. 2025FirstAidQA: A Synthetic Dataset for First Aid and Emergency Response in Low-Connectivity Settingscited by 0
  35. 2025Towards Transparent Stance Detection: A Zero-Shot Approach Using Implicit and Explicit Interpretabilitycited by 0
  36. 2025Query Generation Pipeline with Enhanced Answerability Assessment for Financial Information Retrievalcited by 0
  37. 2026UniFinEval: Towards Unified Evaluation of Financial Multimodal Models across Text, Images and Videoscited by 0
  38. 2026MortarBench: Evaluating Mortgage Loan Origination Agentscited by 0

50 most cited of 54 All 54 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2026Enhancing Financial Question Answering: A Novel Benchmark Dataset of Banks' financial statements
  2. 2024SEC-QA: A Systematic Evaluation Corpus for Financial QA
  3. 2024FinLLMs: A Framework for Financial Reasoning Dataset Generation with Large Language Models
  4. 2024DocFinQA: A Long-Context Financial Reasoning Dataset
  5. 2025VeritasFi: An Adaptable, Multi-tiered RAG Framework for Multi-modal Financial Question Answering
  6. 2025FinGEAR: Financial Mapping-Guided Enhanced Answer Retrieval
  7. 2022PACIFIC: Towards Proactive Conversational Question Answering over Tabular and Textual Data in Finance
  8. 2026Decomposing Retrieval Failures in RAG for Long-Document Financial Question Answering