Hedge-Bench: Benchmarking Agents on Hard, Realistic Tasks Pertaining to Financial Reasoning
Not on the map. Why?
Abstract (arXiv)
AI agents can increasingly handle the mechanical tasks of financial analysis: retrieving documents, calculating formulas, updating spreadsheets. The harder, more valuable challenge is reasoning through the open-ended questions that define expert Analyst work. Existing benchmarks do not capture this class of problem, and those that attempt to evaluate open-ended reasoning rely on model-judged outputs that introduce noise and circularity. We present Hedge-Bench 1.0: a benchmark of 102 actual, on-the-job tasks grounded in the explicit reasoning traces of professional hedge fund analysts working with relevant information sources. This approach enables deterministic grading against verified expert steps. Frontier models and agents score below 16% on the benchmark. We publish the dataset and evaluation harness at github.com/Trata-Inc/trata-hedge-bench.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 7 of its 12 references that are in the map. First posted on arXiv 2 Jun 2026.
Builds on
7 of 12 references.
References · 7
- 2026Terminal-Bench: Benchmarking Agents on Hard, Realistic Tasks in Command Line Interfacescited by 585
- 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
- 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 408
- 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
- 2024FinBen: A Holistic Financial Benchmark for Large Language Modelscited by 141
- 2025Finance Agent Benchmark: Benchmarking LLMs on Real-world Financial Research Taskscited by 65
- 2025MultiFinBen: Benchmarking Large Language Models for Multilingual and Multimodal Financial Applicationcited by 14
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026FinRetrieval: A Benchmark for Financial Data Retrieval by AI Agents
- 2026Herculean: An Agentic Benchmark for Financial Intelligence
- 2025FinSearchComp: Towards a Realistic, Expert-Level Evaluation of Financial Search and Reasoning
- 2026Frontier Financial Judgement: Can agents tell what might move a stock?
- 2026FORCE-Bench: A Benchmark, Dataset, and Evaluation Harness for Agentic AI in Enterprise Finance
- 2026BlueFin: Benchmarking LLM Agents on Financial Spreadsheets
- 2026OpenFinGym: A Verifiable Multi-Task Gym Environment for Evaluating Quant Agents
- 2025FinResearchBench: A Logic Tree based Agent-as-a-Judge Evaluation Framework for Financial Research Agents