mlsanityData to 7 Oct 2026

Long-Horizon Embodied Decision-Making via Multimodal Memory Compression

arXiv 2608.01456 ↗First posted 2 Aug 2026cs.CV cs.CLcited by 0

Not on the map. Why?

Abstract (arXiv)

Agents are increasingly expected to act not only as task executors, but also as decision-makers on behalf of human users. This shift requires agents to accumulate evidence over long horizons, interpret implicit user preferences, and compare multiple candidates under partial observations. In this work, we propose DunphyBench, a new benchmark for evaluating agents on long-horizon human-centered embodied decision-making, where the agent must navigate through multiple embodied housing environments and make decisions that align with multi-dimensional human preferences. Unlike standard embodied reasoning tasks that often focus on procedural planning or immediate goal completion, our setting requires agents to integrate multimodal, multi-source input into coherent knowledge that supports complex reasoning across long horizon. The evaluation results reveal that there is a substantial gap between current agents and human performance. Furthermore, our diagnosis of state-of-the-art VLM-driven agents reveals that memory management is one of the bottlenecks, where raw multimodal history introduces noise that hinders decision quality. Motivated by this finding, we design MeMento, a preference-conditioned multimodal memory compressor that selectively compresses decision-relevant information from long-horizon history based on user preferences with a fixed set of memory tokens. Experiments show that MeMento helps VLM-driven agents improve accuracy by 7.18%, while reducing memory usage by 85.38% compared to the strongest baseline.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 15 references that are in the map. First posted on arXiv 2 Aug 2026.

Builds on

13 of 15 references.

References · 13

  1. 2023WebArena: A Realistic Web Environment for Building Autonomous Agentscited by 1,908
  2. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  3. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
  4. 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 369
  5. 2018BabyAI: A Platform to Study the Sample Efficiency of Grounded Language Learningcited by 238
  6. 2025EmbodiedBench: Comprehensive Benchmarking Multi-modal Large Language Models for Vision-Driven Embodied Agentscited by 213
  7. 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 142
  8. 2025UserBench: An Interactive Gym Environment for User-Centric Agentscited by 69
  9. 2025METAL: A Multi-Agent Framework for Chart Generation with Test-Time Scalingcited by 33
  10. 20253DLLM-Mem: Long-Term Spatial-Temporal Memory for Embodied 3D Large Language Modelcited by 25
  11. 2025Embodied Web Agents: Bridging Physical-Digital Realms for Integrated Agent Intelligencecited by 15
  12. 2025EchoFoley: Event-Centric Hierarchical Control for Video Grounded Creative Sound Generationcited by 5
1 more
  1. 2026PEARL: Self-Evolving Assistant for Time Management with Reinforcement Learningcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025FindingDory: A Benchmark to Evaluate Memory in Embodied Agents
  2. 2026MemCtrl: Using MLLMs as Active Memory Controllers on Embodied Agents
  3. 2026MemPrism: Task-Conditioned Relational Memory Views for Long-Horizon Agents
  4. 2026RPMS: Enhancing LLM-Based Embodied Planning through Rule-Augmented Memory Synergy
  5. 2025RoboMemory: A Brain-inspired Multi-memory Agentic Framework for Interactive Environmental Learning in Physical Embodied Systems
  6. 2026Explore with Long-term Memory: A Benchmark and Multimodal LLM-based Reinforcement Learning Framework for Embodied Exploration
  7. 2026EmbodiedMemory-Bench: Benchmarking Embodied Memory for Long-Horizon Embodied Tasks
  8. 2023Towards End-to-End Embodied Decision Making via Multi-modal Large Language Model: Explorations with GPT4-Vision and Beyond