mlsanityData to 14 Oct 2026

WorldBench: Culturally Grounded Benchmark for Multilingual Agents

arXiv 2609.01056 ↗First posted 1 Sep 2026cs.AI cs.CLcited by 1

On the map: LLM agents and tool use → General LLM agent frameworks and benchmarks

Abstract (arXiv)

Despite the growing use of LLM-powered agents to solve multi-step tasks in complex environments, existing benchmarks rarely test state preservation, performance across languages, and application to realistic, grounded scenarios. To address these concerns, we present WorldBench: a comprehensive, multilingual benchmark of genuine, persona-grounded everyday workflows, where agents can act in a sandbox via structured actions. WorldBench comprises 1,600 tasks across seven languages and eight cultures, filtered and refined through feedback from human annotators with language- and culture-specific expertise. For evaluation, we extend metrics from previous works and introduce Constrained Task Success (CTS), which combines natural language instructions and testbeds to score task completion, minimal modification, and other complementary metrics through deterministic and LLM-as-a-Judge evaluations. Our experiments show that frontier models reach only 49.2% CTS, with all models demonstrating large gaps between correctness and environment preservation. We thereby show that current agents remain brittle in multilingual, agentic scenarios, especially for long-horizon tasks and under state-preservation constraints

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in General LLM agent frameworks and benchmarks, one of 16 directions in LLM agents and tool use. Builds on 20 of its 31 references that are in the map. First posted on arXiv 1 Sep 2026.

Builds on

20 of 31 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025OdysseyBench: Evaluating LLM Agents on Long-Horizon Complex Office Application Workflows12 Aug
  2. 2025A Comprehensive Survey of Self-Evolving AI Agents: A New Paradigm Bridging Foundation Models and Lifelong Agentic Systems10 Aug
  3. 2025X-WebAgentBench: A Multilingual Interactive Web Benchmark for Evaluating Global Agentic System21 May
  4. 2024OfficeBench: Benchmarking Language Agents across Multiple Applications for Office Automation26 Jul
  5. 2024AgentBoard: An Analytical Evaluation Board of Multi-turn LLM Agents24 Jan

Other references · 15

  1. 2022Self-Instruct: Aligning Language Models with Self-Generated Instructionscited by 2,724
  2. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 2,006
  3. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,317
  4. 2022WebShop: Towards Scalable Real-World Web Interaction with Grounded Language Agentscited by 1,251
  5. 2023Mind2Web: Towards a Generalist Agent for the Webcited by 1,242
  6. 2024OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environmentscited by 1,195
  7. 2023WizardLM: Empowering large pre-trained language models to follow complex instructionscited by 1,125
  8. 2023InterCode: Standardizing and Benchmarking Interactive Coding with Execution Feedbackcited by 238
  9. 2024Planning, Creation, Usage: Benchmarking LLMs for Comprehensive Tool Utilization in Real-World Complex Scenarioscited by 86
  10. 2024Lean-STaR: Learning to Interleave Thinking and Provingcited by 68
  11. 2026From Static Templates to Dynamic Runtime Graphs: A Survey of Workflow Optimization for LLM Agentscited by 24
  12. 2025MHier-RAG: Multi-Modal RAG for Visual-Rich Document Question-Answering via Hierarchical and Multi-Granularity Reasoningcited by 11
3 more
  1. 2026ParseBench: A Document Parsing Benchmark for AI Agentscited by 11
  2. 2025What Has Been Lost with Synthetic Evaluation?cited by 9
  3. 2026AgenticShop: Benchmarking Agentic Product Curation for Personalized Web Shoppingcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026LiveCultureBench: a Multi-Agent, Multi-Cultural Benchmark for Large Language Models in Dynamic Social Simulations
  2. 2026BabelArena: A Large-Scale Multilingual Benchmark for LLM Agents
  3. 2026OmnilingualGAIA2: Evaluating the Multilingual Gap in Frontier AI Agents
  4. 2026GAIA-v2-LILT: Multilingual Adaptation of Agent Benchmark beyond Translation
  5. 2026UniClawBench: A Universal Benchmark for Proactive Agents on Real-World Tasks
  6. 2026AgentGym2: Benchmarking Large Language Model Agents in De-Idealized Real-World Environments
  7. 2024BattleAgentBench: A Benchmark for Evaluating Cooperation and Competition Capabilities of Language Models in Multi-Agent Systems
  8. 2025MCPVerse: An Expansive, Real-World Benchmark for Agentic Tool Use