mlsanityData to 13 Oct 2026

FinSkillBench: Evaluating AI Agents and Domain Skills for Investment Management

arXiv 2608.18099 ↗First posted 9 Jun 2026cs.AI q-fin.PMcited by 0

On the map: LLM agents and tool use → Financial trading and forecasting agents

Abstract (arXiv)

Investment management is a high-stakes domain in which agentic AI systems must do more than generate plausible text. They must retrieve point-in-time data, assemble correct computational inputs, invoke specialized methods, and produce auditable structured outputs. We introduce FinSkillBench, an evaluation suite designed to measure whether language model agents can effectively use financial domain skills to solve investment management tasks. The benchmark spans three domains, portfolio construction, risk management, and fundamental analysis, and includes 12 subtasks with 2,603 task episodes. Each episode provides point-in-time inputs, hidden ground truth, and a task-specific verifier.We compare three conditions: no skill, curated skill packages consisting of procedural documents and executable components, and self-generated skills in which the agent writes and reuses its own procedures within an episode. Across 9 models and a large-scale evaluation, curated skills consistently improve performance, raising mean scores from 0.366 to 0.528, with the largest gains in portfolio construction and risk management. In contrast, self-generated skills provide little benefit despite higher computational cost. An independent evaluation using a separate agent framework (Hermes Agent, 8 models, 5,280 episodes total) reproduces the directional pattern across all three domains, with the magnitude of skill effects varying by subtask and harness. These results showthat in investment management agents, access to reliable procedural skills can be as important as model choice, while naive self-generation of skills is often ineffective. We release the benchmark, evaluation tools, curated skill packages, and full trajectories to support further research.

Key facts. No citing papers in the map yet (data through 13 Oct 2026). Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use. Builds on 4 of its 17 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

4 of 17 references.

References · 4

  1. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 553
  2. 2021TAT-QA: A Question Answering Benchmark on a Hybrid of Tabular and Textual Content in Financecited by 405
  3. 2026SkillsBench: Benchmarking How Well Agent Skills Work Across Diverse Taskscited by 302
  4. 2022ConvFinQA: Exploring the Chain of Numerical Reasoning in Conversational Finance Question Answeringcited by 196

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Evaluating Investment Logic in Large Language Models: A Real-World Benchmark Towards Personalzied Financial Agents
  2. 2024FinCon: A Synthesized LLM Multi-Agent System with Conceptual Verbal Reinforcement for Enhanced Financial Decision Making
  3. 2024FinRobot: An Open-Source AI Agent Platform for Financial Applications using Large Language Models
  4. 2026FinToolBench: Evaluating LLM Agents for Real-World Financial Tool Use
  5. 2025FinSearchComp: Towards a Realistic, Expert-Level Evaluation of Financial Search and Reasoning
  6. 2026Toward Expert Investment Teams:A Multi-Agent LLM System with Fine-Grained Trading Tasks
  7. 2024INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agent
  8. 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design