Finch: Benchmarking Finance & Accounting across Spreadsheet-Centric Enterprise Workflows
Not on the map. Why?
Abstract (arXiv)
We introduce FinWorkBench (a.k.a. Finch) for evaluating AI agents on real-world, enterprise-grade finance and accounting workflows that interleave data entry, structuring, formatting, web search, cross-file retrieval, calculation, modeling, validation, translation, visualization, and reporting. Finch is sourced from authentic enterprise workspaces from Enron (15,000 files and 500,000 emails) and other financial institutions, covering the period 2000--2025 and preserving the in-the-wild messiness of multimodal artifacts such as tables and charts across diverse domains including budgeting, trading, asset management, and operational management. We propose a workflow construction process that combines LLM-assisted mining of workflows from authentic enterprise environments with expert annotation: (1) LLM-assisted, expert-verified derivation of workflows from real-world email threads and spreadsheet version histories, and (2) meticulous annotation requiring over 700 hours of expert effort. This yields 172 composite workflows with 384 tasks, involving 1,710 spreadsheets with 27 million cells, along with PDFs and other artifacts, capturing the intrinsically messy, long-horizon, knowledge-intensive, and collaborative nature of real-world enterprise work. We conduct both human and automated evaluations of frontier AI systems, including GPT-5.1, Claude Sonnet 4.5, Claude Opus 4.5, Gemini 3 Pro, Grok 4, and Qwen 3 Max. Under human evaluation, GPT-5.1 Pro spends an average of 16.8 minutes per workflow yet passes only 38.4% of workflows. Comprehensive case studies further surface the challenges that real-world enterprise workflows pose for AI agents.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 37 of its 79 references that are in the map. First posted on arXiv 15 Dec 2025.
Builds on
37 of 79 references.
References · 37
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
- 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
- 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 158
- 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 141
- 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 111
- 2019TableBank: A Benchmark Dataset for Table Detection and Recognitioncited by 102
- 2020TUTA: Tree-based Transformers for Generally Structured Table Pre-trainingcited by 100
- 2024OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automationcited by 70
- 2025WideSearch: Benchmarking Agentic Broad Info-Seekingcited by 69
- 2025Finance Agent Benchmark: Benchmarking LLMs on Real-world Financial Research Taskscited by 65
25 more
- 2024INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agentcited by 64
- 2023SheetCopilot: Bringing Software Productivity to the Next Level through Large Language Modelscited by 57
- 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflowscited by 57
- 2025DABstep: Data Agent Benchmark for Multi-step Reasoningcited by 46
- 2024Multimodal Table Understandingcited by 44
- 2025FinAgentBench: A Benchmark Dataset for Agentic Retrieval in Financial Question Answeringcited by 29
- 2025FinSearchComp: Towards a Realistic, Expert-Level Evaluation of Financial Search and Reasoningcited by 27
- 2021FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretrainingcited by 19
- 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Modelscited by 17
- 2024Tapilot-Crossing: Benchmarking and Evolving LLMs Towards Interactive Data Analysis Agentscited by 17
- 2024SpreadsheetLLM: Encoding Spreadsheets for Large Language Modelscited by 17
- 2023Auto-Tables: Synthesizing Multi-Step Transformations to Relationalize Tables without Using Examplescited by 15
- 2025FinAuditing: A Financial Taxonomy-Structured Multi-Document Benchmark for Evaluating LLMscited by 14
- 2024MiMoTable: A Multi-scale Spreadsheet Benchmark with Meta Operations for Table Reasoningcited by 13
- 2021TableSense: Spreadsheet Table Detection with Convolutional Neural Networkscited by 12
- 2024Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representationscited by 12
- 2025RealHiTBench: A Comprehensive Realistic Hierarchical Table Benchmark for Evaluating LLM-Based Table Analysiscited by 12
- 2025XFinBench: Benchmarking LLMs in Complex Financial Problem Solving and Reasoningcited by 12
- 2024FinDABench: Benchmarking Financial Data Analysis Ability of Large Language Modelscited by 11
- 2024NL2Formula: Generating Spreadsheet Formulas from Natural Language Queriescited by 8
- 2025SheetBrain: A Neuro-Symbolic Agent for Accurate Reasoning over Complex and Large Spreadsheetscited by 8
- 2025VisFinEval: A Scenario-Driven Chinese Multimodal Benchmark for Holistic Financial Understandingcited by 6
- 2024Vision Language Models for Spreadsheet Understanding: Challenges and Opportunitiescited by 4
- 2025MachineLearningLM: Scaling Many-shot In-context Learning via Continued Pretrainingcited by 3
- 2025SODBench: A Large Language Model Approach to Documenting Spreadsheet Operationscited by 1
Built on by
Citing papers per year: 2026: 10.
10 papers.
- 2026FutureX-Pro: Extending Future Prediction to High-Value Vertical Domainscited by 9
- 2026Beyond Rows to Reasoning: Agentic Retrieval for Multimodal Spreadsheet Understanding and Editingcited by 4
- 2026Herculean: An Agentic Benchmark for Financial Intelligencecited by 4
- 2026DocOps: A Verifiable Benchmark for Autonomous Agents in Complex Document Operationscited by 1
- 2026IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifiercited by 1
- 2026FinRCA-Bench: Benchmarking Evidence Retrieval and Reasoning for Financial AI Systemscited by 0
- 2026FinExam-10K: When Retrieval Helps Financial Reasoning?cited by 0
- 2026FinCUABuild: Can Agents Build Reliable Benchmarks for Dynamic Financial Computer Use?cited by 0
- 2026Debiasing as a Measurement Intervention: Calibrated Ties and Resolution Loss in LLM-as-a-Judge Evaluationcited by 0
- 2026Knowledge or Calculator? Decomposing the Skill Premium in Verifiable Financial Agent Workflowscited by 0
- 2026Knowledge or Calculator? Decomposing the Skill Premium in Verifiable Financial Agent Workflows2 Oct 2026
- 2026Debiasing as a Measurement Intervention: Calibrated Ties and Resolution Loss in LLM-as-a-Judge Evaluation11 Sep 2026
- 2026IBIB: A Protocol for Measuring Enterprise AI Systems by Serving Route, Not Model Identifier9 Sep 2026
- 2026FinCUABuild: Can Agents Build Reliable Benchmarks for Dynamic Financial Computer Use?7 Sep 2026
- 2026FinExam-10K: When Retrieval Helps Financial Reasoning?28 Aug 2026
- 2026FinRCA-Bench: Benchmarking Evidence Retrieval and Reasoning for Financial AI Systems19 Aug 2026
- 2026DocOps: A Verifiable Benchmark for Autonomous Agents in Complex Document Operations22 Jul 2026
- 2026Herculean: An Agentic Benchmark for Financial Intelligence14 May 2026
- 2026Beyond Rows to Reasoning: Agentic Retrieval for Multimodal Spreadsheet Understanding and Editing6 Mar 2026
- 2026FutureX-Pro: Extending Future Prediction to High-Value Vertical Domains18 Jan 2026