mlsanityData to 7 Oct 2026

FrontierFinance: A Long-Horizon Computer-Use Benchmark of Real-World Financial Tasks

arXiv 2604.05912 ↗First posted 7 Apr 2026cs.CLcited by 2

Not on the map. Why?

Abstract (arXiv)

As concerns surrounding AI-driven labor displacement intensify in knowledge-intensive sectors, existing benchmarks fail to measure performance on tasks that define practical professional expertise. Finance, in particular, has been identified as a domain with high AI exposure risk, yet lacks robust benchmarks to track real-world developments. This gap is compounded by the absence of clear accountability mechanisms in current Large Language Model (LLM) deployments. To address this, we introduce FrontierFinance, a long-horizon benchmark of 25 complex financial modeling tasks across five core finance models, requiring an average of over 18 hours of skilled human labor per task to complete. Developed with financial professionals, the benchmark reflects industry-standard financial modeling workflows and is paired with detailed rubrics for structured evaluation. We engage human experts to define the tasks, create rubrics, grade LLMs, and perform the tasks themselves as human baselines. We demonstrate that our human experts both receive higher scores on average, and are more likely to provide client-ready outputs than current state-of-the-art systems.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 21 of its 29 references that are in the map. First posted on arXiv 7 Apr 2026.

Builds on

21 of 29 references.

References · 21

  1. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  3. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  4. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  5. 2023G-Eval: NLG Evaluation using GPT-4 with Better Human Alignmentcited by 2,205
  6. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,970
  7. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  8. 2023Prometheus: Inducing Fine-grained Evaluation Capability in Language Modelscited by 558
  9. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
  10. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
  11. 2026Meta-Harness: End-to-End Optimization of Model Harnessescited by 248
  12. 2024MT-Bench-101: A Fine-Grained Benchmark for Evaluating Large Language Models in Multi-Turn Dialoguescited by 247
9 more
  1. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 194
  2. 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 142
  3. 2025SWE-Lancer: Can Frontier LLMs Earn 1 Million from Real-World Freelance Software Engineering?cited by 99
  4. 2024DocFinQA: A Long-Context Financial Reasoning Datasetcited by 59
  5. 2025MCP-RADAR: A Multi-Dimensional Benchmark for Evaluating Tool Use Capabilities in Large Language Modelscited by 48
  6. 2023FinanceMath: Knowledge-Intensive Math Reasoning in Finance Domainscited by 39
  7. 2026LongCLI-Bench: A Preliminary Benchmark and Study for Long-horizon Agentic Programming in Command-Line Interfacescited by 29
  8. 2023BizBench: A Quantitative Reasoning Benchmark for Business and Financecited by 28
  9. 2025XFinBench: Benchmarking LLMs in Complex Financial Problem Solving and Reasoningcited by 12

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.