EconWebArena: Benchmarking Autonomous Agents on Economic Tasks in Realistic Web Environments
On the map: LLM agents and tool use → Web, search, and research agents
Abstract (arXiv)
We introduce EconWebArena, a benchmark for evaluating autonomous agents on complex, multimodal economic tasks in realistic web environments. The benchmark comprises 360 curated tasks from 82 authoritative websites spanning domains such as macroeconomics, labor, finance, trade, and public policy. Each task challenges agents to navigate live websites, interpret structured and visual content, interact with real interfaces, and extract precise, time-sensitive data through multi-step workflows. We construct the benchmark by prompting multiple large language models (LLMs) to generate candidate tasks, followed by rigorous human curation to ensure clarity, feasibility, and source reliability. Unlike prior work, EconWebArena emphasizes fidelity to authoritative data sources and the need for grounded web-based economic reasoning. We evaluate a diverse set of state-of-the-art multimodal LLMs as web agents, analyze failure cases, and conduct ablation studies to assess the impact of visual grounding, plan-based reasoning, and interaction design. Our results reveal substantial performance gaps and highlight persistent challenges in grounding, navigation, and multimodal understanding, positioning EconWebArena as a rigorous testbed for economic web intelligence.
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Placed in Web, search, and research agents, one of 16 directions in LLM agents and tool use. Builds on 23 of its 48 references that are in the map. First posted on arXiv 9 Jun 2025.
Builds on
23 of 48 references.
Closest ancestors · 8
Same direction, newest first
- 2024The BrowserGym Ecosystem for Web Agent Research6 Dec
- 2024AssistantBench: Can Web Agents Solve Realistic and Time-Consuming Tasks?22 Jul
- 2024WebCanvas: Benchmarking Web Agents in Online Environments18 Jun
- 2024MMInA: Benchmarking Multihop Multimodal Internet Agents15 Apr
- 2024WorkArena: How Capable Are Web Agents at Solving Common Knowledge Work Tasks?12 Mar
- 2023WebArena: A Realistic Web Environment for Building Autonomous Agents25 Jul
- 2023Mind2Web: Towards a Generalist Agent for the Web9 Jun
- 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agents4 Jul
Other references · 15
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2023Set-of-Mark Prompting Unleashes Extraordinary Visual Grounding in GPT-4Vcited by 291
- 2023FinanceBench: A New Benchmark for Financial Question Answeringcited by 261
- 2024WebLINX: Real-World Website Navigation with Multi-Turn Dialoguecited by 177
- 2024A Multimodal Foundation Agent for Financial Trading: Tool-Augmented, Diversified, and Generalistcited by 137
- 2022WHEN FLUE MEETS FLANG: Benchmarks and Large Pre-trained Language Model for Financial Domaincited by 117
- 2024VisualAgentBench: Towards Large Multimodal Models as Visual Foundation Agentscited by 101
- 2024VisualWebBench: How Far Have Multimodal LLMs Evolved in Web Page Understanding and Grounding?cited by 98
- 2024WorkArena++: Towards Compositional Planning and Reasoning-based Common Knowledge Work Taskscited by 81
- 2024CRMArena: Understanding the Capacity of LLM Agents to Perform Professional CRM Tasks in Realistic Environmentscited by 69
- 2023BBT-Fin: Comprehensive Construction of Chinese Financial Domain Pre-trained Language Model, Corpus and Benchmarkcited by 60
- 2024VideoWebArena: Evaluating Long Context Multimodal Agents with Video Understanding Web Taskscited by 43
Built on by
Citing papers per year: 2025: 4; 2026: 4.
8 papers.
- 2026ClawBench: Can AI Agents Complete Everyday Online Tasks?cited by 28
- 2025CRMAgent: A Multi-Agent LLM System for E-Commerce CRM Message Template Generationcited by 5
- 2025AutoBnB-RAG: Enhancing Multi-Agent Incident Response with Retrieval-Augmented Generationcited by 3
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agentscited by 2
- 2026MacAgentBench: Benchmarking AI Agents on Real-World macOS Desktopcited by 2
- 2025AgentBnB: A Browser-Based Cybersecurity Tabletop Exercise with Large Language Model Support and Retrieval-Aligned Scaffoldingcited by 0
- 2026How Long Is a Piece of String? A Brief Empirical Analysis of Tokenizerscited by 0
- 2026EconSkills: Studying Skill Transfer and Retrieval for Web Agents on Live Economic Datacited by 0
- 2026EconSkills: Studying Skill Transfer and Retrieval for Web Agents on Live Economic Data17 Sep 2026
- 2026MacAgentBench: Benchmarking AI Agents on Real-World macOS Desktop21 Jun 2026
- 2026ClawBench: Can AI Agents Complete Everyday Online Tasks?9 Apr 2026
- 2026How Long Is a Piece of String? A Brief Empirical Analysis of Tokenizers16 Jan 2026
- 2025AgentBnB: A Browser-Based Cybersecurity Tabletop Exercise with Large Language Model Support and Retrieval-Aligned Scaffolding31 Oct 2025
- 2025Empowering Real-World: A Survey on the Technology, Practice, and Evaluation of LLM-driven Industry Agents20 Oct 2025
- 2025AutoBnB-RAG: Enhancing Multi-Agent Incident Response with Retrieval-Augmented Generation18 Aug 2025
- 2025CRMAgent: A Multi-Agent LLM System for E-Commerce CRM Message Template Generation11 Jul 2025
Similar, not cited
Close in wording, no citation either way
- 2025REAL: Benchmarking Autonomous Agents on Deterministic Simulations of Real Websites
- 2026AgencyBench: Benchmarking the Frontiers of Autonomous Agents in 1M-Token Real-World Contexts
- 2024Towards a Realistic Long-Term Benchmark for Open-Web Research Agents
- 2024VisualWebArena: Evaluating Multimodal Agents on Realistic Visual Web Tasks
- 2026EcoAgent-Bench: Evaluating Economic Decision-Making in Budget-Constrained LLM Agents
- 2025WebArxiv: A Reproducible Benchmark for Evaluating Multimodal Web Agents on arXiv Tasks
- 2025An Illusion of Progress? Assessing the Current State of Web Agents
- 2024Web Agents with World Models: Learning and Leveraging Environment Dynamics in Web Navigation