EmbodiedMemory-Bench: Benchmarking Embodied Memory for Long-Horizon Embodied Tasks
Not on the map. Why?
Abstract (arXiv)
Long-horizon embodied interaction requires agents to retain and continually update information about the environment as they observe, act, and encounter change. Yet current agents struggle to maintain such memory reliably. Our analysis traces this limitation to four key deficiencies: weak fine-grained visual memory, unreliable dynamic world-state tracking, failing to record world state revealed by interaction outcomes, and limited generalization from prior experience. However, existing benchmarks do not directly assess these memory capabilities during long-horizon embodied interaction. To address this gap, we introduce EmbodiedMemory-Bench (EMem-Bench), comprising 2,554 interactive episodes across four task families. EMem-Bench requires agents to build and update memory from interaction history, then use it to complete a later task by acting in the environment. We further present Embodied-Memorizer (EMem), an external memory system that organizes embodied experience into spatial, event, and scene memories. We also train EMem-8B, an 8B policy that manages and uses these memories. We evaluate a diverse range of open-source and proprietary MLLMs and representative multimodal memory systems. Results show that current models remain weak and uneven across the four challenges. Under matched backbones, EMem achieves the best overall performance among the evaluated memory systems and improves both open-source and proprietary models, while EMem-8B further improves over its backbone. Project page: https://zju-omniai.github.io/EmbodiedMemoryBench/
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 31 of its 43 references that are in the map. First posted on arXiv 23 Sep 2026.
Builds on
31 of 43 references.
References · 31
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 850
- 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 800
- 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 656
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 529
- 2024MMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmarkcited by 494
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
- 2025Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactionscited by 236
- 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
- 2025Evo-Memory: Benchmarking LLM Agent Test-time Learning with Self-Evolving Memorycited by 129
19 more
- 2025Cambrian-S: Towards Spatial Supersensing in Videocited by 123
- 2024GOAT-Bench: A Benchmark for Multi-Modal Lifelong Navigationcited by 93
- 2026Mem-Gallery: Benchmarking Multimodal Long-Term Conversational Memory for MLLM Agentscited by 49
- 2025Embodied-Reasoner: Synergizing Visual Search, Reasoning, and Action for Embodied Interactive Taskscited by 43
- 2026RoboMME: Benchmarking and Understanding Memory for Robotic Generalist Policiescited by 39
- 2025MemVerse: Multimodal Memory for Lifelong Learning Agentscited by 31
- 2025OST-Bench: Evaluating the Capabilities of MLLMs in Online Spatio-temporal Scene Understandingcited by 24
- 2026RoboMemArena: A Comprehensive and Challenging Robotic Memory Benchmarkcited by 21
- 2025TeleMem: Building Long-Term and Multimodal Memory for Agentic AIcited by 14
- 2026Explore with Long-term Memory: A Benchmark and Multimodal LLM-based Reinforcement Learning Framework for Embodied Explorationcited by 13
- 2025FindingDory: A Benchmark to Evaluate Memory in Embodied Agentscited by 11
- 2026EgoMemReason: A Memory-Driven Reasoning Benchmark for Long-Horizon Egocentric Video Understandingcited by 11
- 2025Memo: Training Memory-Efficient Embodied Agents with Reinforcement Learningcited by 9
- 2026SpaMEM: Benchmarking Dynamic Spatial Reasoning via Perception-Memory Integration in Embodied Environmentscited by 6
- 2025PersONAL: Towards a Comprehensive Benchmark for Personalized Embodied Agentscited by 4
- 2026WorldLines: Benchmarking and Modeling Long-Horizon Stateful Embodied Agentscited by 4
- 2025Affordance RAG: Hierarchical Multimodal Retrieval with Affordance-Aware Embodied Memory for Mobile Manipulationcited by 3
- 2026MemCompiler: Compile, Don't Inject -- State-Conditioned Memory for Embodied Agentscited by 3
- 2026From Local Corrections to Generalized Skills: Improving Neuro-Symbolic Policies with MEMOcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026EMBER-Bench: Benchmarking Cross-Event Causal Memory in Long-Horizon Embodied Tasks
- 2026eMEM: A Hybrid Spatio-Temporal Memory System For Embodied Agents
- 2024KARMA: Augmenting Embodied AI Agents with Long-and-short Term Memory Systems
- 2025Embodied Agents Meet Personalization: Investigating Challenges and Solutions Through the Lens of Memory Utilization
- 2026Personalizing Embodied Multimodal Large Language Model Agents over Long-term User Interactions
- 20253DLLM-Mem: Long-Term Spatial-Temporal Memory for Embodied 3D Large Language Model
- 2026WorldMemArena: Evaluating Multimodal Agent Memory Through Action-World Interaction
- 2026BrainMem: Brain-Inspired Evolving Memory for Embodied Agent Task Planning