mlsanityData to 7 Oct 2026

FinRpt: Dataset, Evaluation System and LLM-based Multi-agent Framework for Equity Research Report Generation

arXiv 2511.07322 ↗First posted 10 Nov 2025cs.CL cs.AIcited by 6

On the map: LLM agents and tool use → Financial trading and forecasting agents

Abstract (arXiv)

While LLMs have shown great success in financial tasks like stock prediction and question answering, their application in fully automating Equity Research Report generation remains uncharted territory. In this paper, we formulate the Equity Research Report (ERR) Generation task for the first time. To address the data scarcity and the evaluation metrics absence, we present an open-source evaluation benchmark for ERR generation - FinRpt. We frame a Dataset Construction Pipeline that integrates 7 financial data types and produces a high-quality ERR dataset automatically, which could be used for model training and evaluation. We also introduce a comprehensive evaluation system including 11 metrics to assess the generated ERRs. Moreover, we propose a multi-agent framework specifically tailored to address this task, named FinRpt-Gen, and train several LLM-based agents on the proposed datasets using Supervised Fine-Tuning and Reinforcement Learning. Experimental results indicate the data quality and metrics effectiveness of the benchmark FinRpt and the strong performance of FinRpt-Gen, showcasing their potential to drive innovation in the ERR generation field. All code and datasets are publicly available.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use. Builds on 20 of its 45 references that are in the map. First posted on arXiv 10 Nov 2025.

Builds on

20 of 45 references.

Closest ancestors · 1

Same direction, newest first

  1. 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design23 Nov

Other references · 19

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2024The Llama 3 Herd of Modelscited by 14,192
  3. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 8,851
  4. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,393
  5. 2019BERTScore: Evaluating Text Generation with BERTcited by 5,462
  6. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  7. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,678
  8. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  9. 2023BloombergGPT: A Large Language Model for Financecited by 923
  10. 2023GPTScore: Evaluate as You Desirecited by 357
  11. 2023Sentiment Analysis in the Era of Large Language Models: A Reality Checkcited by 262
  12. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
7 more
  1. 2023PIXIU: A Large Language Model, Instruction Data and Evaluation Benchmark for Financecited by 217
  2. 2024Aligning with Human Judgement: The Role of Pairwise Preference in Large Language Model Evaluatorscited by 146
  3. 2024A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalistcited by 137
  4. 2023XuanYuan 2.0: A Large Chinese Financial Chat Model with Hundreds of Billions Parameterscited by 92
  5. 2025FinMME: Benchmark Dataset for Financial Multi-Modal Reasoning Evaluationcited by 27
  6. 2024A Reflective LLM-based Agent to Guide Zero-shot Cryptocurrency Tradingcited by 10
  7. 2025AI Analyst: Framework and Comprehensive Evaluation of Large Language Models for Financial Time Series Report Generationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2024FinRobot: AI Agent for Equity Research and Valuation with Large Language Models
  2. 2025FinResearchBench: A Logic Tree based Agent-as-a-Judge Evaluation Framework for Financial Research Agents
  3. 2024FinBen: A Holistic Financial Benchmark for Large Language Models
  4. 2025Towards Competent AI for Fundamental Analysis in Finance: A Benchmark Dataset and Evaluation
  5. 2026FinDeepForecast: A Live Multi-Agent System for Benchmarking Deep Research Agents in Financial Forecasting
  6. 2026FinDeepIndicator: Benchmarking Deep Research Agents in End-to-End Financial Indicator Construction
  7. 2025FinSearchComp: Towards a Realistic, Expert-Level Evaluation of Financial Search and Reasoning
  8. 2024INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agent