mlsanityData to 7 Oct 2026

EconWebArena: Benchmarking Autonomous Agents on Economic Tasks in Realistic Web Environments

arXiv 2506.08136 ↗First posted 9 Jun 2025cs.CLcited by 8

On the map: LLM agents and tool use → Web, search, and research agents

Abstract (arXiv)

We introduce EconWebArena, a benchmark for evaluating autonomous agents on complex, multimodal economic tasks in realistic web environments. The benchmark comprises 360 curated tasks from 82 authoritative websites spanning domains such as macroeconomics, labor, finance, trade, and public policy. Each task challenges agents to navigate live websites, interpret structured and visual content, interact with real interfaces, and extract precise, time-sensitive data through multi-step workflows. We construct the benchmark by prompting multiple large language models (LLMs) to generate candidate tasks, followed by rigorous human curation to ensure clarity, feasibility, and source reliability. Unlike prior work, EconWebArena emphasizes fidelity to authoritative data sources and the need for grounded web-based economic reasoning. We evaluate a diverse set of state-of-the-art multimodal LLMs as web agents, analyze failure cases, and conduct ablation studies to assess the impact of visual grounding, plan-based reasoning, and interaction design. Our results reveal substantial performance gaps and highlight persistent challenges in grounding, navigation, and multimodal understanding, positioning EconWebArena as a rigorous testbed for economic web intelligence.

Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 48 references that are in the map. First posted on arXiv 9 Jun 2025.

Builds on

23 of 48 references.

Closest ancestors · 8

Same direction, newest first

  1. 2024The BrowserGym Ecosystem for Web Agent Research6 Dec
  2. 2024AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?22 Jul
  3. 2024WebCanvas: Benchmarking Web Agents in Online Environments18 Jun
  4. 2024MMInA: Benchmarking Multihop Multimodal Internet Agents15 Apr
  5. 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?12 Mar
  6. 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul
  7. 2023Mind2Web: Towards a Generalist Agent for the Web9 Jun
  8. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents4 Jul

Other references · 15

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
  3. 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
  4. 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 177
  5. 2024A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalistcited by 137
  6. 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
  7. 2024VisualAgentBench: Towards Large Multimodal Models as Visual Foundation Agentscited by 101
  8. 2024VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?cited by 98
  9. 2024WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Taskscited by 81
  10. 2024CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environmentscited by 69
  11. 2023BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmarkcited by 60
  12. 2024VideoWebArena: Evaluating Long Context Multimodal Agents with Video Understanding Web Taskscited by 43
3 more
  1. 2024EconLogicQA: A Question-Answering Benchmark for Evaluating Large Language Models in Economic Sequential Reasoningcited by 21
  2. 2025RealWebAssist: A Benchmark for Long-Horizon Web Assistance with Real-World Userscited by 21
  3. 2024Economics Arena for Large Language Modelscited by 17

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 4; 2026: 4.

8 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites
  2. 2026AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts
  3. 2024Towards a Realistic Long-Term Benchmark for Open-Web Research Agents
  4. 2024VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks
  5. 2026EcoAgent-Bench: Evaluating Economic Decision-Making in Budget-Constrained LLM Agents
  6. 2025WebArxiv: A Reproducible Benchmark for Evaluating Multimodal Web Agents on arXiv Tasks
  7. 2025An Illusion of Progress? Assessing the Current State of Web Agents
  8. 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation