mlsanityData to 14 Oct 2026

When Agents Trade: Live Multi-Market Trading Benchmark for LLM Agents

arXiv 2510.11695 ↗First posted 13 Oct 2025cs.CLcited by 16

On the map: LLM agents and tool use → Financial trading and forecasting agents

Abstract (arXiv)

Although Large Language Model (LLM)-based agents are increasingly used in financial trading, it remains unclear whether they can reason and adapt in live markets, as most studies test models instead of agents, cover limited periods and assets, and rely on unverified data. To address these gaps, we introduce Agent Market Arena (AMA), the first lifelong, real-time benchmark for evaluating LLM-based trading agents across multiple markets. AMA integrates verified trading data, expert-checked news, and diverse agent architectures within a unified trading framework, enabling fair and continuous comparison under real conditions. It implements four agents, including InvestorAgent as a single-agent baseline, TradeAgent and HedgeFundAgent with different risk styles, and DeepFundAgent with memory-based reasoning, and evaluates them across GPT-4o, GPT-4.1, Claude-3.5-haiku, Claude-sonnet-4, and Gemini-2.0-flash. Live experiments on both cryptocurrency and stock markets demonstrate that agent frameworks display markedly distinct behavioral patterns, spanning from aggressive risk-taking to conservative decision-making, whereas model backbones contribute less to outcome variation. AMA thus establishes a foundation for rigorous, reproducible, and continuously evolving evaluation of financial reasoning and trading intelligence in LLM-based agents.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Financial trading and forecasting agents, one of 16 directions in LLM agents and tool use. Builds on 9 of its 44 references that are in the map. First posted on arXiv 13 Oct 2025.

Builds on

9 of 44 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025FLAG-Trader: Fusion LLM-Agent with Gradient-based Reinforcement Learning for Financial Trading17 Feb
  2. 2024TradingAgents: Multi-Agents LLM Financial Trading Framework28 Dec
  3. 2023FinMem: A Performance-Enhanced LLM Trading Agent with Layered Memory and Character Design23 Nov

Other references · 6

  1. 2021FinQA: A Dataset of Numerical Reasoning over Financial Datacited by 562
  2. 2013Good Debt or Bad Debt: Detecting Semantic Orientations in Economic Textscited by 310
  3. 2023Generative AIcited by 120
  4. 2022FiNER: Financial Numeric Entity Recognition for XBRL Taggingcited by 50
  5. 2025Plutus: Benchmarking Large Language Models in Low-Resource Greek Financecited by 18
  6. 2024Developing A Multi-Agent and Self-Adaptive Framework with Deep Reinforcement Learning for Dynamic Portfolio Risk Managementcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 16.

16 papers.

Sort:

By area:

  1. 2026Quantifying Trust: Financial Risk Management for Trustworthy AI Agentscited by 8
  2. 2026Agentic Trading: When LLM Agents Meet Financial Marketscited by 7
  3. 2026Toward Reliable Evaluation of LLM-Based Financial Multi-Agent Systems: Taxonomy, Coordination Primacy, and Cost Awarenesscited by 5
  4. 2026FinReporting: An Agentic Workflow for Localized Reporting of Cross-Jurisdiction Financial Disclosurescited by 5
  5. 2026The Alpha Illusion: Reported Alpha from LLM Trading Agents Should Not Be Treated as Deployment Evidencecited by 3
  6. 2026OpenFinGym: A Verifiable Multi-Task Gym Environment for Evaluating Quant Agentscited by 2
  7. 2026E-Commerce Bench: Evaluating LLM Agents on Long-Horizon Autonomous Business Operationcited by 2
  8. 2026TruthTensor: Evaluating LLMs through Human Imitation on Prediction Market under Drift and Holistic Reasoningcited by 1
  9. 2026Evaluating Financial Intelligence in Large Language Models: Benchmarking SuperInvesting AI with LLM Enginescited by 1
  10. 2026TimeSeek: Temporal Reliability of Agentic Forecasterscited by 1
  11. 2026Moira: Language-driven Hierarchical Reinforcement Learning for Pair Tradingcited by 1
  12. 2026Paper Agents, Paper Gains: An Empirical Analysis of DeFi Investment Agentscited by 1
4 more
  1. 2026LATTICE: Evaluating Decision Support Utility of Crypto Agentscited by 0
  2. 2026ChainClaw: A Layered Agent Framework for Reliable On-Chain Executioncited by 0
  3. 2026Can Language Models Learn to Forecast Stock Pricescited by 0
  4. 2026ReLiveGym: Evaluating Long-Lived Agents over Weeks of Replayed Realitycited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Agent Trading Arena: A Study on Numerical Understanding in LLM-Based Agents
  2. 2024INVESTORBENCH: A Benchmark for Financial Decision-Making Tasks with LLM-based Agent
  3. 2025LiveTradeBench: Seeking Real-World Alpha with Large Language Models
  4. 2024Large Language Model Agent in Financial Trading: A Survey
  5. 2025ContestTrade: A Multi-Agent Trading System Based on Internal Contest Mechanism
  6. 2026Beyond Agent Architecture: Execution Assumptions and Reproducibility in LLM-Based Trading Systems
  7. 2025StockSim: A Dual-Mode Order-Level Simulator for Evaluating Multi-Agent LLMs in Financial Markets
  8. 2025StockBench: Can LLM Agents Trade Stocks Profitably In Real-world Markets?