EvoEmpirBench: Dynamic Spatial Reasoning with Agent-ExpVer
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Most existing spatial reasoning benchmarks focus on static or globally observable environments, failing to capture the challenges of long-horizon reasoning and memory utilization under partial observability and dynamic changes. We introduce two dynamic spatial benchmarks, locally observable maze navigation and match-2 elimination that systematically evaluate models' abilities in spatial understanding and adaptive planning when local perception, environment feedback, and global objectives are tightly coupled. Each action triggers structural changes in the environment, requiring continuous update of cognition and strategy. We further propose a subjective experience-based memory mechanism for cross-task experience transfer and validation. Experiments show that our benchmarks reveal key limitations of mainstream models in dynamic spatial reasoning and long-term memory, providing a comprehensive platform for future methodological advances. Our code and data are available at https://anonymous.4open.science/r/EvoEmpirBench-143C/.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 67 of its 82 references that are in the map. First posted on arXiv 16 Sep 2025.
Builds on
67 of 82 references.
References · 67
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2021Training Verifiers to Solve Math Word Problemscited by 10,109
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
38 more
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2023Generative Agents: Interactive Simulacra of Human Behaviorcited by 3,568
- 2022OPT: Open Pre-trained Transformer Language Modelscited by 3,512
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
- 2022Beyond the Imitation Game: Quantifying and extrapolating the capabilities of language modelscited by 1,998
- 2023AutoGen: Enabling Next-Gen LLM Applications via Multi-Agent Conversationcited by 1,988
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,808
- 2024Chatbot Arena: An Open Platform for Evaluating LLMs by Human Preferencecited by 1,184
- 2018Experience Replay for Continual Learningcited by 1,095
- 2023A Comprehensive Survey of Continual Learning: Theory, Method and Applicationcited by 872
- 2022GLM-130B: An Open Bilingual Pre-trained Modelcited by 843
- 2021Dynabench: Rethinking Benchmarking in NLPcited by 459
- 2024Contrastive Preference Optimization: Pushing the Boundaries of LLM Performance in Machine Translationcited by 394
- 2022PlanBench: An Extensible Benchmark for Evaluating Large Language Models on Planning and Reasoning about Changecited by 382
- 2023How Good Are GPT Models at Machine Translation? A Comprehensive Evaluationcited by 348
- 2023NLP Evaluation in trouble: On the Need to Measure LLM Data Contamination for each Benchmarkcited by 348
- 2022Language Models Are Greedy Reasoners: A Systematic Formal Analysis of Chain-of-Thoughtcited by 337
- 2024Humans or LLMs as the Judge? A Study on Judgement Biasescited by 323
- 2021Rainbow Memory: Continual Learning with a Memory of Diverse Samplescited by 273
- 2023AdaPlanner: Adaptive Planning from Feedback with Language Modelscited by 196
- 2023Multilingual Machine Translation with Large Language Models: Empirical Results and Analysiscited by 160
- 2018Adaptive Online Learning in Dynamic Environmentscited by 133
- 2023SmartPlay: A Benchmark for LLMs as Intelligent Agentscited by 125
- 2023CLIN: A Continually Learning Language Agent for Rapid Task Adaptation and Generalizationcited by 95
- 2024Agent-Pro: Learning to Evolve via Policy-Level Reflection and Optimizationcited by 94
- 2023Document-Level Machine Translation with Large Language Modelscited by 90
- 2024RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agentscited by 80
- 2023Data-Copilot: Bridging Billions of Data and Humans with Autonomous Workflowcited by 76
- 2024LLM Reasoners: New Evaluation, Library, and Analysis of Step-by-Step Reasoning with Large Language Modelscited by 70
- 2024AutoManual: Constructing Instruction Manuals by LLM Agents via Interactive Environmental Learningcited by 61
- 2024From LLM to NMT: Advancing Low-Resource Machine Translation with Claudecited by 58
- 2023Real-Time Evaluation in Online Continual Learning: A New Hopecited by 47
- 2024Auto-Arena: Automating LLM Evaluations with Agent Peer Battles and Committee Discussionscited by 42
- 2025VideoGen-of-Thought: Step-by-step generating multi-shot video with minimal manual interventioncited by 36
- 2024GameArena: Evaluating LLM Reasoning through Live Computer Gamescited by 32
- 2024Online Continual Learning For Interactive Instruction Following Agentscited by 22
50 most cited of 67 All 67 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systemscited by 14
- 2026WorldLines: Benchmarking and Modeling Long-Horizon Stateful Embodied Agentscited by 5
- 2026STAR: Mitigating Cascading Errors in Spatial Reasoning via Turn-point Alignment and Segment-level DPOcited by 4
- 2026No Place to Hide: Benchmarking Video Hallucination with Background-Controlled Pairscited by 2
- 2026Are Frontier VLM Agents Ready to Be Robot Generalists? An Empirical Study with the Embodied Agent Arenacited by 0
- 2026Are Frontier VLM Agents Ready to Be Robot Generalists? An Empirical Study with the Embodied Agent Arena1 Oct 2026
- 2026No Place to Hide: Benchmarking Video Hallucination with Background-Controlled Pairs30 Jun 2026
- 2026WorldLines: Benchmarking and Modeling Long-Horizon Stateful Embodied Agents17 Jun 2026
- 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems16 Apr 2026
- 2026STAR: Mitigating Cascading Errors in Spatial Reasoning via Turn-point Alignment and Segment-level DPO1 Apr 2026
Similar, not cited
Close in wording, no citation either way
- 2026VCN-Bench: A Video-Contextualized Navigation Benchmark for Spatial Reasoning over Prior Visual Experience
- 2025CubeBench: Diagnosing Interactive, Long-Horizon Spatial Reasoning Under Partial Observations
- 2025Bridging the Dynamic Perception Gap: Training-Free Draft Chain-of-Thought for Dynamic Multimodal Spatial Reasoning
- 2026Spatial Memory Agent: Experience-Grounded Procedure Memory for Spatial Intelligence
- 2026Active Exploring like a Pigeon: Reinforcing Spatial Reasoning via Agentic Vision-Language Models
- 2025Probing the effectiveness of World Models for Spatial Reasoning through Test-time Scaling
- 2026Beyond Spatial Benchmarks: From Spatial Reasoning to Navigation
- 2026EvoSpatial: Experience-Driven Skill and Tool Evolution for Spatial Reasoning Agents