mlsanityData to 7 Oct 2026

FinEvo-Bench: A Longitudinal Benchmark for Self-Evolving Agents in Professional Financial Workflows

arXiv 2608.06144 ↗First posted 6 Aug 2026cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

Agents used over time encounter recurring professional work: each case requires different evidence and judgment, while the underlying workflow can be reused. Benchmarks built from independent tasks cannot reveal whether an agent turns earlier experience into better procedures for later cases. We introduce FinEvo-Bench, a longitudinal benchmark designed around this structure. It contains 120 open-ended tasks drawn from real cases across 20 business scenes in six financial domains. Each scene contains six substantively different cases that share a professional workflow and an expert-authored rubric for task quality and financial compliance. Constructing and validating the benchmark required approximately 1,200 person-hours. Finance provides a natural test bed because recurring analyses apply shared professional and compliance requirements to heterogeneous inputs, producing case-specific analyses and conclusions. We evaluate four self-evolving agent scaffolds with Qwen3.7-Max on three independently shuffled, globally interleaved task streams. A Claude Code rubric judge backed by Claude Opus~4.6 evaluates all outputs, and paired state-reset controls estimate each scaffold's gain from retained experience. Evolving runs score 9.33--19.37 points higher and trigger 0.12--0.44 fewer compliance issues per task than their paired controls. Paired score gains at within-scene ranks~4--6 exceed those at ranks~1--3 by 6.10--8.70 points. FinEvo-Bench measures whether retained experience improves later professional work under continued use.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 28 of its 30 references that are in the map. First posted on arXiv 6 Aug 2026.

Builds on

28 of 30 references.

References · 28

  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  2. 2023SWE-bench: Can Language Models Resolve Real-World GitHub Issues?cited by 3,193
  3. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,081
  4. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  5. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,134
  6. 2023ExpeL: LLM Agents Are Experiential Learnerscited by 814
  7. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 552
  8. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 402
  9. 2024AFlow: Automating Agentic Workflow Generationcited by 395
  10. 2025RAGEN: Understanding Self-Evolution in LLM Agents via Multi-Turn Reinforcement Learningcited by 357
  11. 2025Agentic Context Engineering: Evolving Contexts for Self-Improving Language Modelscited by 349
  12. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
16 more
  1. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 194
  2. 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
  3. 2025LifelongAgentBench: Evaluating LLM Agents as Lifelong Learnerscited by 65
  4. 2025Finance Agent Benchmark: Benchmarking LLMs on Real-world Financial Research Taskscited by 63
  5. 2024Offline Training of Language Model Agents with Functions as Learnable Weightscited by 47
  6. 2025Building Self-Evolving Agents via Experience-Driven Lifelong Learning: A Framework and Benchmarkcited by 43
  7. 2025FinAgentBench: A Benchmark Dataset for Agentic Retrieval in Financial Question Answeringcited by 29
  8. 2026EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspectivecited by 14
  9. 2026Frontier-Eng: Benchmarking Self-Evolving Agents on Real-World Engineering Tasks with Generative Optimizationcited by 13
  10. 2026SEA-Eval: A Benchmark for Evaluating Self-Evolving Agents Beyond Episodic Assessmentcited by 12
  11. 2026GenericAgent: A Token-Efficient Self-Evolving LLM Agent via Contextual Information Density Maximization (V1.0)cited by 10
  12. 2026SEAGym: An Evaluation Environment for Self-Evolving LLM Agentscited by 8
  13. 2025SECQUE: A Benchmark for Evaluating Real-World Financial Analysis Capabilitiescited by 6
  14. 2025FinRpt: Dataset, Evaluation System and LLM-based Multi-agent Framework for Equity Research Report Generationcited by 6
  15. 2026FinMCP-Bench: Benchmarking LLM Agents for Real-World Financial Tool Use under the Model Context Protocolcited by 6
  16. 2026BlueFin: Benchmarking LLM Agents on Financial Spreadsheetscited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.