mlsanityData to 7 Oct 2026

FinDeepForecast: A Live Multi-Agent System for Benchmarking Deep Research Agents in Financial Forecasting

arXiv 2601.05039 ↗First posted 8 Jan 2026cs.MAcited by 4

On the map: LLM agents and tool use → Financial trading and forecasting agents

Abstract (arXiv)

Deep Research (DR) Agents powered by advanced Large Language Models (LLMs) have fundamentally shifted the paradigm for completing complex research tasks. Yet, a comprehensive and live evaluation of their forecasting performance on real-world, research-oriented tasks in high-stakes domains (e.g., finance) remains underexplored. We introduce FinDeepForecast, the first live, end-to-end multi-agent system for automatically evaluating DR agents by continuously generating research-oriented financial forecasting tasks. This system is equipped with a dual-track taxonomy, enabling the dynamic generation of recurrent and non-recurrent forecasting tasks at both corporate and macro levels. With this system, we generate FinDeepForecastBench, a weekly evaluation benchmark over a ten-week horizon, encompassing 8 global economies and 1,314 listed companies, and evaluate 13 representative methods. Extensive experiments show that, while DR agents consistently outperform strong baselines, their performance still falls short of genuine forward-looking financial reasoning. We expect the proposed FinDeepForecast system to consistently facilitate future advancements of DR agents in research-oriented financial forecasting tasks. The benchmark and leaderboard are publicly available on the OpenFinArena Platform.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use. Builds on 18 of its 33 references that are in the map. First posted on arXiv 8 Jan 2026.

Builds on

18 of 33 references.

Closest ancestors · 2

Same direction, newest first

  1. 2025FinDeepResearch: Evaluating Deep Research Agents in Rigorous Financial Analysis15 Oct
  2. 2025FutureX: An Advanced Live Benchmark for LLM Agents in Future Prediction16 Aug

Other references · 16

  1. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,355
  2. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  3. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  4. 2024LiveCodeBench: Holistic and Contamination Free Evaluation of Large Language Models for Codecited by 1,906
  5. 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 339
  6. 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitionscited by 275
  7. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
  8. 2024LiveBench: A Challenging, Contamination-Limited LLM Benchmarkcited by 242
  9. 2024Leak, Cheat, Repeat: Data Contamination and Evaluation Malpractices in Closed-Source LLMscited by 224
  10. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 217
  11. 2025Deep Research Agents: A Systematic Examination And Roadmapcited by 122
  12. 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
4 more
  1. 2024ForecastBench: A Dynamic Benchmark of AI Forecasting Capabilitiescited by 104
  2. 2017Listening to Chaotic Whispers: A Deep Learning Framework for News-oriented Stock Trend Predictioncited by 60
  3. 2025CAMEF: Causal-Augmented Multi-Modality Event-Driven Financial Forecasting by Integrating Time Series Patterns and Salient Macroeconomic Announcementscited by 5
  4. 2025FinCall-Surprise: A Large Scale Multi-modal Benchmark for Earning Surprise Predictioncited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025FinResearchBench: A Logic Tree based Agent-as-a-Judge Evaluation Framework for Financial Research Agents
  2. 2025MASFIN: A Multi-Agent System for Decomposed Financial Reasoning and Forecasting
  3. 2026FinanceHarness: Autonomous Financial Deep Research Framework
  4. 2026Time Series Augmented Generation for Financial Applications
  5. 2026OpenFinGym: A Verifiable Multi-Task Gym Environment for Evaluating Quant Agents
  6. 2026Mint-Agent: Introducing Finance-Native Agentic Foundation Models
  7. 2026EvoCast: Reliable Autonomous Research Agents for Iterative Forecasting Architecture Evolution
  8. 2026From Narrative to Auditable Forecasts: A Structured Scaffold for Agentic Forecasting