mlsanityData to 14 Oct 2026

BigFinanceBench: A Workflow-Grounded Benchmark for Financial-Research Agents

arXiv 2606.03829 ↗First posted 2 Jun 2026cs.AIcited by 7

On the map: LLM agents and tool use → Financial trading and forecasting agents

Abstract (arXiv)

Financial-research answers are decision-relevant only when another analyst can audit how they were produced: which source was chosen, which period and accounting definition were used, which assumptions were made, and how the calculation was performed. Existing finance benchmarks largely evaluate isolated subskills or final answers, leaving the auditable derivation itself under-measured. We introduce BigFinanceBench, a 928-item expert-authored benchmark of open-ended financial-research tasks in which each item pairs a ground-truth reference answer with a point-weighted rubric that decomposes the derivation into independently checkable steps. BigFinanceBench is workflow-grounded in that it evaluates the full derivation rather than only the final output. Across 36,241 rubric points, the benchmark supports partial-credit evaluation and localization of failures across the analyst workflow. Evaluating ten current frontier and open-weight agents, we find substantial headroom: the best system reaches only 58.8% rubric score, final-answer accuracy is a useful but lossy proxy for derivation quality, and model capability varies non-uniformly across financial workflows.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use. Builds on 29 of its 39 references that are in the map. First posted on arXiv 2 Jun 2026.

Builds on

29 of 39 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025FinAgentBench: A Benchmark Dataset for Agentic Retrieval in Financial Question Answering7 Aug

Other references · 28

  1. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  2. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,879
  3. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  4. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  5. 2025HealthBench: Evaluating Large Language Models Towards Improved Human Healthcited by 429
  6. 2025Rubrics as Rewards: Reinforcement Learning Beyond Verifiable Domainscited by 366
  7. 2024ToolSandbox: A Stateful, Conversational, Interactive Evaluation Benchmark for LLM Tool Use Capabilitiescited by 295
  8. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
  9. 2025MultiChallenge: A Realistic Multi-Turn Conversation Evaluation Benchmark Challenging to Frontier LLMscited by 180
  10. 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 158
  11. 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 141
  12. 2025Reinforcement Learning with Rubric Anchorscited by 113
16 more
  1. 2025AgentRewardBench: Evaluating Automatic Evaluations of Web Agent Trajectoriescited by 108
  2. 2025SWE-Lancer: Can Frontier LLMs Earn 1 Million from Real-World Freelance Software Engineering?cited by 105
  3. 2025Finance Agent Benchmark: Benchmarking LLMs on Real-world Financial Research Taskscited by 65
  4. 2024DocFinQA: A Long-Context Financial Reasoning Datasetcited by 60
  5. 2024FinTextQA: A Dataset for Long-form Financial Question Answeringcited by 54
  6. 2023FinanceMath: Knowledge-Intensive Math Reasoning in Finance Domainscited by 40
  7. 2025PRBench: Large-Scale Expert Rubrics for Evaluating High-Stakes Professional Reasoningcited by 32
  8. 2025ProfBench: Multi-Domain Rubrics requiring Professional Knowledge to Answer and Judgecited by 24
  9. 2024FAMMA: A Benchmark for Financial Domain Multilingual Multimodal Question Answeringcited by 20
  10. 2025Remote Labor Index: Measuring AI Automation of Remote Workcited by 20
  11. 2025FinDER: Financial Dataset for Question Answering and Evaluating Retrieval-Augmented Generationcited by 17
  12. 2025The AI Productivity Index (APEX)cited by 10
  13. 2025ToolComp: A Multi-Tool Reasoning & Process Supervision Benchmarkcited by 9
  14. 2026FinTradeBench: A Financial Reasoning Benchmark for LLMscited by 5
  15. 2024Redefining Information Retrieval of Structured Database via Large Language Modelscited by 4
  16. 2026FinRetrieval: A Benchmark for Financial Data Retrieval by AI Agentscited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026BankerToolBench: Evaluating AI Agents in End-to-End Investment Banking Workflows
  2. 2026FinReasoning: A Hierarchical Benchmark for Reliable Financial Research Reporting
  3. 2026FinResearchBench II: A Deep Research Benchmark with Consensus-Derived Gold Rubrics for Distinguishing Financial Report Quality
  4. 2026FinToolBench: Evaluating LLM Agents for Real-World Financial Tool Use
  5. 2026FinDeepIndicator: Benchmarking Deep Research Agents in End-to-End Financial Indicator Construction
  6. 2026DataClawBench: An Agent Benchmark for Exploratory Real-World Financial Data Analysis
  7. 2026BlueFin: Benchmarking LLM Agents on Financial Spreadsheets
  8. 2026FinFIRST: Benchmarking Search Agents for Financial Information Retrieval, Sourcing and Traceability