mlsanityData to 14 Oct 2026

TextArena

arXiv 2504.11442 ↗First posted 15 Apr 2025cs.CL cs.AI cs.LGcited by 27

Not on the map. Why?

Abstract (arXiv)

TextArena is an open-source collection of competitive text-based games for training and evaluation of agentic behavior in Large Language Models (LLMs). It spans 57+ unique environments (including single-player, two-player, and multi-player setups) and allows for easy evaluation of model capabilities via an online-play system (against humans and other submitted models) with real-time TrueSkill scores. Traditional benchmarks rarely assess dynamic social skills such as negotiation, theory of mind, and deception, creating a gap that TextArena addresses. Designed with research, community and extensibility in mind, TextArena emphasizes ease of adding new games, adapting the framework, testing models, playing against the models, and training models. Detailed documentation of environments, games, leaderboard, and examples are available on https://github.com/LeonGuertler/TextArena and https://www.textarena.ai/.

Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). Builds on 13 of its 17 references that are in the map. First posted on arXiv 15 Apr 2025.

Builds on

13 of 17 references.

References · 13

  1. 2021Evaluating Large Language Models Trained on Codecited by 8,320
  2. 2020Measuring Massive Multitask Language Understandingcited by 7,963
  3. 2025DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learningcited by 6,330
  4. 2025Humanity's Last Examcited by 491
  5. 2021Dynabench: Rethinking Benchmarking in NLPcited by 459
  6. 2024GTBench: Uncovering the Strategic Reasoning Limitations of LLMs via Game-Theoretic Evaluationscited by 120
  7. 2024GameBench: Evaluating Strategic Reasoning Abilities of LLM Agentscited by 95
  8. 2023LMRL Gym: Benchmarks for Multi-Turn Reinforcement Learning with Language Modelscited by 88
  9. 2024Game-theoretic LLM: Agent Workflow for Negotiation Gamescited by 56
  10. 2023Clembench: Using Game Play to Evaluate Chat-Optimized Language Models as Conversational Agentscited by 54
  11. 2024Evaluating Language Model Agency through Negotiationscited by 48
  12. 2024GameArena: Evaluating LLM Reasoning through Live Computer Gamescited by 32
1 more
  1. 2025SPIN-Bench: How Well Do LLMs Plan Strategically and Reason Socially?cited by 24

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 8; 2026: 19.

27 papers.

Sort:

By area:

  1. 2025A Survey of Reinforcement Learning for Large Reasoning Modelscited by 180
  2. 2025Code World Models for General Game Playingcited by 26
  3. 2025From Code Foundation Models to Agents and Applications: A Comprehensive Survey and Practical Guide to Code Intelligencecited by 15
  4. 2025Cogito, Ergo Ludo: An Agent that Learns to Play by Reasoning and Planningcited by 12
  5. 2026SPADE: Self-Play in Adaptive Synthetic Executable Environmentscited by 12
  6. 2026Agentic Environment Engineering for Large Language Models: A Survey of Environment Modeling, Synthesis, Evaluation, and Applicationcited by 8
  7. 2025KORGym: A Dynamic Game Platform for LLM Reasoning Evaluationcited by 7
  8. 2025TextAtari: 100K Frames Game Playing with Language Agentscited by 6
  9. 2026DemoEvolve: Overcoming Sparse Feedback in Agentic Harness Evolution with Demonstrationscited by 6
  10. 2025CATArena: Evaluating Evolutionary Capabilities of Code Agents via Iterative Tournamentscited by 5
  11. 2026MEMO: Memory-Augmented Model Context Optimization for Robust Multi-Turn Multi-Agent LLM Gamescited by 5
  12. 2026MINDGAMES: A Live Arena for Evaluating Social and Strategic Reasoning in Multi-Agent LLMscited by 5
15 more
  1. 2026Scaling Large Reasoning Models beyond Human Supervision: A Path toward Superintelligencecited by 5
  2. 2026Correct Answers from Sound Reasoning: Verifiable Process Supervision for Language Modelscited by 4
  3. 2026When Context Returns: Toward Robust Internalization in On-Policy Distillationcited by 3
  4. 2026AI for Games in the Foundation Model Eracited by 3
  5. 2026Hidden in Plain Text: Measuring LLM Deception Quality Against Human Baselines Using Social Deduction Gamescited by 2
  6. 2026LatentGym: A Testbed For Cross-Task Experiential Learning With Controllable Latent Structurecited by 2
  7. 2026Social Gym and SPaRTan: Benchmarking and Improving LLM Social Reasoning via Multi-Agent Game Tournamentscited by 2
  8. 2025Unveiling the Learning Mind of Language Models: A Cognitive Framework and Empirical Studycited by 1
  9. 2026Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic Evaluationcited by 1
  10. 2026Stratagem: Learning Transferable Reasoning via Trajectory-Modulated Game Self-Playcited by 0
  11. 2026Multi-Turn Multi-Agent Dialogue for Collaborative Reconstruction Improves VLM Performance on Spatial Reasoning, But Only Barelycited by 0
  12. 2026Self-Play Search Distillation for Large Language Model Reasoningcited by 0
  13. 2026Finding the Move Is Not Winning the Game: XiangqiBench for Closed-Loop Evaluation of LLM Agentscited by 0
  14. 2026SpeedrunBench: Challenging LLM Agents with Video Game Speedrunningcited by 0
  15. 2026Can AI Agents Learn Their Way to the Top? Evaluating Heuristic Learning in a Long-Running Game Agent Competitioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025TextQuests: How Good are LLMs at Text-Based Video Games?
  2. 2025MathArena: Evaluating LLMs on Uncontaminated Math Competitions
  3. 2025ByteSized32Refactored: Towards an Extensible Interactive Text Games Corpus for LLM World Modeling and Evaluation
  4. 2025TextGames: Learning to Self-Play Text-Based Puzzle Games via Language Model Reasoning
  5. 2024clembench-2024: A Challenging, Dynamic, Complementary, Multilingual Benchmark and Underlying Flexible Framework for LLMs as Multi-Action Agents
  6. 2024TimeArena: Shaping Efficient Multitasking Language Agents in a Time-Aware Simulation
  7. 2024Game Agent Driven by Free-Form Text Command: Using LLM-based Code Generation and Behavior Branch
  8. 2025TALES: Text Adventure Learning Environment Suite