mlsanityData to 14 Oct 2026

Finch: Benchmarking Finance & Accounting across Spreadsheet-Centric Enterprise Workflows

arXiv 2512.13168 ↗First posted 15 Dec 2025cs.AI cs.CE cs.IRcited by 10

Not on the map. Why?

Abstract (arXiv)

We introduce FinWorkBench (a.k.a. Finch) for evaluating AI agents on real-world, enterprise-grade finance and accounting workflows that interleave data entry, structuring, formatting, web search, cross-file retrieval, calculation, modeling, validation, translation, visualization, and reporting. Finch is sourced from authentic enterprise workspaces from Enron (15,000 files and 500,000 emails) and other financial institutions, covering the period 2000--2025 and preserving the in-the-wild messiness of multimodal artifacts such as tables and charts across diverse domains including budgeting, trading, asset management, and operational management. We propose a workflow construction process that combines LLM-assisted mining of workflows from authentic enterprise environments with expert annotation: (1) LLM-assisted, expert-verified derivation of workflows from real-world email threads and spreadsheet version histories, and (2) meticulous annotation requiring over 700 hours of expert effort. This yields 172 composite workflows with 384 tasks, involving 1,710 spreadsheets with 27 million cells, along with PDFs and other artifacts, capturing the intrinsically messy, long-horizon, knowledge-intensive, and collaborative nature of real-world enterprise work. We conduct both human and automated evaluations of frontier AI systems, including GPT-5.1, Claude Sonnet 4.5, Claude Opus 4.5, Gemini 3 Pro, Grok 4, and Qwen 3 Max. Under human evaluation, GPT-5.1 Pro spends an average of 16.8 minutes per workflow yet passes only 38.4% of workflows. Comprehensive case studies further surface the challenges that real-world enterprise workflows pose for AI agents.

Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 37 of its 79 references that are in the map. First posted on arXiv 15 Dec 2025.

Builds on

37 of 79 references.

References · 37

  1. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  2. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  3. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
  4. 2024CharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMscited by 234
  5. 2025GDPval: Evaluating AI Model Performance on Real-World Economically Valuable Taskscited by 158
  6. 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 141
  7. 2024SpreadsheetBench: Towards Challenging Real World Spreadsheet Manipulationcited by 111
  8. 2019TableBank: A Benchmark Dataset for Table Detection and Recognitioncited by 102
  9. 2020TUTA: Tree-based Transformers for Generally Structured Table Pre-trainingcited by 100
  10. 2024OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automationcited by 70
  11. 2025WideSearch: Benchmarking Agentic Broad Info-Seekingcited by 69
  12. 2025Finance Agent Benchmark: Benchmarking LLMs on Real-world Financial Research Taskscited by 65
25 more
  1. 2024INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agentcited by 64
  2. 2023SheetCopilot: Bringing Software Productivity to the Next Level through Large Language Modelscited by 57
  3. 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflowscited by 57
  4. 2025DABstep: Data Agent Benchmark for Multi-step Reasoningcited by 46
  5. 2024Multimodal Table Understandingcited by 44
  6. 2025FinAgentBench: A Benchmark Dataset for Agentic Retrieval in Financial Question Answeringcited by 29
  7. 2025FinSearchComp: Towards a Realistic, Expert-Level Evaluation of Financial Search and Reasoningcited by 27
  8. 2021FORTAP: Using Formulas for Numerical-Reasoning-Aware Table Pretrainingcited by 19
  9. 2024SheetAgent: Towards A Generalist Agent for Spreadsheet Reasoning and Manipulation via Large Language Modelscited by 17
  10. 2024Tapilot-Crossing: Benchmarking and Evolving LLMs Towards Interactive Data Analysis Agentscited by 17
  11. 2024SpreadsheetLLM: Encoding Spreadsheets for Large Language Modelscited by 17
  12. 2023Auto-Tables: Synthesizing Multi-Step Transformations to Relationalize Tables without Using Examplescited by 15
  13. 2025FinAuditing: A Financial Taxonomy-Structured Multi-Document Benchmark for Evaluating LLMscited by 14
  14. 2024MiMoTable: A Multi-scale Spreadsheet Benchmark with Meta Operations for Table Reasoningcited by 13
  15. 2021TableSense: Spreadsheet Table Detection with Convolutional Neural Networkscited by 12
  16. 2024Auto-Formula: Recommend Formulas in Spreadsheets using Contrastive Learning for Table Representationscited by 12
  17. 2025RealHiTBench: A Comprehensive Realistic Hierarchical Table Benchmark for Evaluating LLM-Based Table Analysiscited by 12
  18. 2025XFinBench: Benchmarking LLMs in Complex Financial Problem Solving and Reasoningcited by 12
  19. 2024FinDABench: Benchmarking Financial Data Analysis Ability of Large Language Modelscited by 11
  20. 2024NL2Formula: Generating Spreadsheet Formulas from Natural Language Queriescited by 8
  21. 2025SheetBrain: A Neuro-Symbolic Agent for Accurate Reasoning over Complex and Large Spreadsheetscited by 8
  22. 2025VisFinEval: A Scenario-Driven Chinese Multimodal Benchmark for Holistic Financial Understandingcited by 6
  23. 2024Vision Language Models for Spreadsheet Understanding: Challenges and Opportunitiescited by 4
  24. 2025MachineLearningLM: Scaling Many-shot In-context Learning via Continued Pretrainingcited by 3
  25. 2025SODBench: A Large Language Model Approach to Documenting Spreadsheet Operationscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 10.

10 papers.