mlsanityData to 14 Oct 2026

RoboMME-Interference: Benchmarking Robot Memory Under Interference

arXiv 2606.22338 ↗First posted 21 Jun 2026cs.RO cs.AI cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Robots deployed in realistic settings will accumulate experience across many sessions and tasks over their deployment. The robot's tasks may often require it to remember information from multiple sessions ago, making long-context robot memory important for real-world deployments. However, most robot-memory benchmarks today are based on single episodes or a short context. To measure how current robot memory systems perform on longer sessions with more distractions, we introduce RoboMME-Interference, a cross-session benchmark built on RoboMME (Dai et al., 2026). For each query episode, we construct a session history using the query's relevant prior demonstration followed by a controlled number of unrelated sessions, which we provide to the VLA as memory and measure accuracy. Running RoboMME's released memory-augmented π0.5 variants unmodified through this benchmark, we find that while perceptual memory variants improve success when given the history without any distractors, they decay strongly and steadily as unrelated sessions accumulate. The subgoal variants, which read the history with a vision-language model and pass written subgoals to the policy, improve less at their best but hold more of that improvement as distractors accumulate. Adding a retrieval step to the strongest perceptual variant, which selects the section of history most visually similar to the robot's current view and passes only that section to the policy, restores its no-distractor success rate at every interference level. With this release, we emphasize the importance of long-context memory and robustness to interference and show that current systems largely fail on such capabilities. The project page, videos, code, and data are at https://robotmemorybench.com.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 21 of its 23 references that are in the map. First posted on arXiv 21 Jun 2026.

Builds on

21 of 23 references.

References · 21

  1. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  2. 2023Lost in the Middle: How Language Models Use Long Contextscited by 3,455
  3. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  7. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  8. 2020ColBERT: Efficient and Effective Passage Search via Contextualized Late Interaction over BERTcited by 1,178
  9. 2022Token Merging: Your ViT But Fastercited by 1,021
  10. 2024Evaluating Very Long-Term Conversational Memory of LLM Agentscited by 830
  11. 2024LongMemEval: Benchmarking Chat Assistants on Long-Term Interactive Memorycited by 707
  12. 2024Learning to (Learn at Test Time): RNNs with Expressive Hidden Statescited by 355
9 more
  1. 2022Recurrent Memory Transformercited by 203
  2. 2023Self-Chained Image-Language Model for Video Localization and Question Answeringcited by 203
  3. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
  4. 2025MemER: Scaling Up Memory for Robot Control via Experience Retrievalcited by 67
  5. 2026MEM: Multi-Scale Embodied Memory for Vision Language Action Modelscited by 61
  6. 2025Beyond a Million Tokens: Benchmarking and Enhancing Long-Term Memory in LLMscited by 60
  7. 2026RMBench: Memory-Dependent Robotic Manipulation Benchmark with Insights into Policy Designcited by 45
  8. 2025MAP-VLA: Memory-Augmented Prompting for Vision-Language-Action Model in Robotic Manipulationcited by 28
  9. 2026RoboMemArena: A Comprehensive and Challenging Robotic Memory Benchmarkcited by 22

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026RoboMME: Benchmarking and Understanding Memory for Robotic Generalist Policies
  2. 2026ECoMEM: Explicit Concept Memory for Memory-Dependent Robot Control ↗
  3. 2026T2Mem: Learning Test-Time Memory for Robotics ↗
  4. 2026Simple Agentic Memory for Generalist Robot Policies
  5. 2026MEMOBench: A Process Level Memory Benchmark for Robotic Manipulation
  6. 2026Remember Smarter: Visual History Compressor and Hyperbolic Experience Space for Robotic Memory
  7. 2026OnEvoMemory: Evolving Memory through Online Robot Rollouts for Pretrained Robot Policies ↗
  8. 2026Can a Frontier VLM Serve as a Robot Policy for Memory-Dependent Manipulation?