mlsanityData to 14 Oct 2026

FinanceHarness: Autonomous Financial Deep Research Framework

arXiv 2607.27853 ↗First posted 30 Jul 2026cs.CL cs.AI q-fin.CPcited by 2

On the map: LLM agents and tool use → Financial trading and forecasting agents

Abstract (arXiv)

Powered by advances in LLMs and autonomous agents, deep research has become one of the most widely adopted agentic products. However, most deep research systems write general-purpose reports, which are inadequate for financial deep research. Financial research demands specialized knowledge to analyze historical patterns and forecast upcoming events. Automating financial deep research therefore requires both a layered harness to drive the research agent and a verifiable, point-in-time benchmark that prevents leakage of future information. We present FinanceHarness, a harness that runs finance-oriented tools and practitioner-guided workflows, automating financial deep research end to end: environment and data construction, the agent execution loop, and reward modeling. We further propose FinanceGym, comprising thesis-driven research questions and rubrics that combine pre-cutoff and post-cutoff criteria. Professional expert validation yields an 82% pass rate. With the same open-weight backbone, FinanceHarness improves the overall rubric score from 25.3% to 32.4%, demonstrating the effectiveness of our specialized harness design. However, even pairing FinanceHarness with the most cutting edge LLM (e.g. Opus-5), the FinanceGym score is below 45%, showing that it is a challenging benchmark for financial deep research. Leaderboard is available at: https://financegym.github.io/ and FinanceHarness code is available at: https://github.com/Yijia-Xiao/FinanceHarness.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use. Builds on 24 of its 40 references that are in the map. First posted on arXiv 30 Jul 2026.

Builds on

24 of 40 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024TradingAgents: Multi-Agents LLM Financial Trading Framework28 Dec

Other references · 23

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  2. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  3. 2023BloombergGPT: A Large Language Model for Financecited by 939
  4. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 872
  5. 2025BrowseComp: A Simple Yet Challenging Benchmark for Browsing Agentscited by 647
  6. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 270
  7. 2023FinGPT: Open-Source Financial Large Language Modelscited by 253
  8. 2025DeepResearch Bench: A Comprehensive Benchmark for Deep Research Agentscited by 248
  9. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 222
  10. 2025BrowseComp-Plus: A More Fair and Transparent Evaluation Benchmark of Deep-Research Agentcited by 200
  11. 2025ResearchRubrics: A Benchmark of Prompts and Rubrics For Evaluating Deep Research Agentscited by 84
  12. 2025MiroThinker: Pushing the Performance Boundaries of Open-Source Research Agents via Model, Context, and Interactive Scalingcited by 81
11 more
  1. 2025Tongyi DeepResearch Technical Reportcited by 66
  2. 2025DeepResearchGym: A Free, Transparent, and Reproducible Evaluation Sandbox for Deep Researchcited by 53
  3. 2026Code as Agent Harnesscited by 47
  4. 2025LiveResearchBench: A Live Benchmark for User-Centric Deep Research in the Wildcited by 37
  5. 2026OpenResearcher: A Fully Open Pipeline for Long-Horizon Deep Research Trajectory Synthesiscited by 37
  6. 2025DeepScholar-Bench: A Live Benchmark and Automated Evaluation for Generative Research Synthesiscited by 34
  7. 2026DeepResearch Bench II: Diagnosing Deep Research Agents via Rubrics from Expert Reportscited by 34
  8. 2026MiroThinker-1.7 & H1: Towards Heavy-Duty Research Agents via Verificationcited by 32
  9. 2025Trading-R1: Financial Trading with LLM Reasoning via Reinforcement Learningcited by 15
  10. 2026MiroEval: Benchmarking Multimodal Deep Research Agents in Process and Outcomecited by 6
  11. 2025Deep Researcher with Test-Time Diffusioncited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025FinDeepResearch: Evaluating Deep Research Agents in Rigorous Financial Analysis
  2. 2025FinResearchBench: A Logic Tree based Agent-as-a-Judge Evaluation Framework for Financial Research Agents
  3. 2026FinDeepForecast: A Live Multi-Agent System for Benchmarking Deep Research Agents in Financial Forecasting
  4. 2026FinResearchBench II: A Deep Research Benchmark with Consensus-Derived Gold Rubrics for Distinguishing Financial Report Quality
  5. 2026FinReasoning: A Hierarchical Benchmark for Reliable Financial Research Reporting
  6. 2024FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models
  7. 2026FinDeepIndicator: Benchmarking Deep Research Agents in End-to-End Financial Indicator Construction
  8. 2026FinToolBench: Evaluating LLM Agents for Real-World Financial Tool Use