mlsanityData to 14 Oct 2026

EvoEmpirBench: Dynamic Spatial Reasoning with Agent-ExpVer

arXiv 2509.12718 ↗First posted 16 Sep 2025cs.CVcited by 5

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

Most existing spatial reasoning benchmarks focus on static or globally observable environments, failing to capture the challenges of long-horizon reasoning and memory utilization under partial observability and dynamic changes. We introduce two dynamic spatial benchmarks, locally observable maze navigation and match-2 elimination that systematically evaluate models' abilities in spatial understanding and adaptive planning when local perception, environment feedback, and global objectives are tightly coupled. Each action triggers structural changes in the environment, requiring continuous update of cognition and strategy. We further propose a subjective experience-based memory mechanism for cross-task experience transfer and validation. Experiments show that our benchmarks reveal key limitations of mainstream models in dynamic spatial reasoning and long-term memory, providing a comprehensive platform for future methodological advances. Our code and data are available at https://anonymous.4open.science/r/EvoEmpirBench-143C/.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 67 of its 82 references that are in the map. First posted on arXiv 16 Sep 2025.

Builds on

67 of 82 references.

References · 67

  1. 2020Language Models are Few-Shot Learnerscited by 32,419
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2024The Llama 3 Herd of Modelscited by 14,715
  5. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  6. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  7. 2021Training Verifiers to Solve Math Word Problemscited by 10,109
  8. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  9. 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
  10. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  11. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  12. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
38 more
  1. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
  2. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  3. 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
  4. 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
  5. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  6. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  7. 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
  8. 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
  9. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
  10. 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
  11. 2018Experience Replay for Continual Learningcited by 1,095
  12. 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
  13. 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
  14. 2021Dynabench: Rethinking Benchmarking in NLPcited by 459
  15. 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 394
  16. 2022PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Changecited by 382
  17. 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
  18. 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 348
  19. 2022Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thoughtcited by 337
  20. 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 323
  21. 2021Rainbow Memory: Continual Learning with a Memory of Diverse Samplescited by 273
  22. 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 196
  23. 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 160
  24. 2018Adaptive Online Learning in Dynamic Environmentscited by 133
  25. 2023SmartPlay: A Benchmark for LLMs as Intelligent Agentscited by 125
  26. 2023CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalizationcited by 95
  27. 2024Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimizationcited by 94
  28. 2023Document-Level Machine Translation with Large Language Modelscited by 90
  29. 2024RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agentscited by 80
  30. 2023Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflowcited by 76
  31. 2024LLM Reasoners: New Evaluation, Library, and Analysis of Step-by-Step Reasoning with Large Language Modelscited by 70
  32. 2024AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learningcited by 61
  33. 2024From LLM to NMT: Advancing Low-Resource Machine Translation with Claudecited by 58
  34. 2023Real-Time Evaluation in Online Continual Learning: A New Hopecited by 47
  35. 2024Auto-Arena: Automating LLM Evaluations with Agent Peer Battles and Committee Discussionscited by 42
  36. 2025VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual interventioncited by 36
  37. 2024GameArena: Evaluating LLM Reasoning through Live Computer Gamescited by 32
  38. 2024Online Continual Learning For Interactive Instruction Following Agentscited by 22

50 most cited of 67 All 67 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026VCN-Bench: A Video-Contextualized Navigation Benchmark for Spatial Reasoning over Prior Visual Experience
  2. 2025CubeBench: Diagnosing Interactive, Long-Horizon Spatial Reasoning Under Partial Observations
  3. 2025Bridging the Dynamic Perception Gap: Training-Free Draft Chain-of-Thought for Dynamic Multimodal Spatial Reasoning
  4. 2026Spatial Memory Agent: Experience-Grounded Procedure Memory for Spatial Intelligence
  5. 2026Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models
  6. 2025Probing the effectiveness of World Models for Spatial Reasoning through Test-time Scaling
  7. 2026Beyond Spatial Benchmarks: From Spatial Reasoning to Navigation
  8. 2026EvoSpatial: Experience-Driven Skill and Tool Evolution for Spatial Reasoning Agents