mlsanityData to 14 Oct 2026

Event-Centric World Modeling with Memory-Augmented Retrieval for Embodied Decision-Making

arXiv 2604.07392 ↗First posted 8 Apr 2026cs.LG cs.IR cs.ROcited by 0

On the map: World models → World models for navigation

Abstract (arXiv)

Autonomous agents operating in dynamic environments increasingly demand decision-making systems that are both efficient and interpretable. Hence we propose the Event-Retrieve-Action (ERA) framework, an alternative formulation for embodied decision-making that bridges the gap between black-box imitation and interpretable memory retrieval while enabling online refinement without retraining. The environment is represented as structured semantic events encoded into an interpretable latent representation, and decisions are generated by retrieving relevant prior experiences from a knowledge bank of event-action pairs. Final actions are produced through weighted aggregation of retrieved maneuvers, enabling transparent and physically consistent decision-making. Experiments in UAV navigation demonstrate real-time performance and adaptive behavior in dynamic environments as a representative embodied decision-making application scenario.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in World models for navigation, one of 11 directions in World models. Builds on 27 of its 46 references that are in the map. First posted on arXiv 8 Apr 2026.

Builds on

27 of 46 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025A Comprehensive Survey on World Models for Embodied AI19 Oct

Other references · 26

  1. 2017Attention Is All You Needcited by 60,361
  2. 2017Proximal Policy Optimization Algorithmscited by 15,215
  3. 2020Retrieval-Augmented Generation for Knowledge-Intensive NLP Taskscited by 9,297
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  6. 2017Billion-scale similarity search with GPUscited by 2,497
  7. 2016Matching Networks for One Shot Learningcited by 2,255
  8. 2018World Modelscited by 1,513
  9. 2017Deep Setscited by 1,421
  10. 2017Towards A Rigorous Science of Interpretable Machine Learningcited by 1,416
  11. 2019Event-based Vision: A Surveycited by 1,016
  12. 2016End to End Learning for Self-Driving Carscited by 1,009
14 more
  1. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  2. 2016Efficient and robust approximate nearest neighbor search using Hierarchical Navigable Small World graphscited by 861
  3. 2016ORB-SLAM2: an Open-Source SLAM System for Monocular, Stereo and RGB-D Camerascited by 806
  4. 2014Neural Turing Machinescited by 644
  5. 2017Robust Adversarial Reinforcement Learningcited by 451
  6. 2017Safe Model-based Reinforcement Learning with Stability Guaranteescited by 366
  7. 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
  8. 2017Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperationcited by 289
  9. 2025FLARE: Robot Learning with Implicit World Modelingcited by 113
  10. 2019acados: a modular open-source framework for fast embedded optimal controlcited by 68
  11. 2024Retrieval-Augmented Embodied Agentscited by 31
  12. 2026Memory Matters More: Event-Centric Memory as a Logic Map for Agent Searching and Reasoningcited by 17
  13. 2025DyG-RAG: Dynamic Graph Retrieval-Augmented Generation with Event-Centric Reasoningcited by 8
  14. 2026Memory Bank Compression for Continual Adaptation of Large Language Modelscited by 4

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Drones that Think on their Feet: Sudden Landing Decisions with Embodied AI
  2. 2025FindingDory: A Benchmark to Evaluate Memory in Embodied Agents
  3. 2026SearchWorld: Spatial Value-Grounded Imagination for UAV Object Search via World Models
  4. 2026Long-Horizon Embodied Decision-Making via Multimodal Memory Compression
  5. 2026What Should Embodied Agents Remember? Benchmarking and Evaluating Memory Modality for Embodied Agents
  6. 2026APEX: A Decoupled Memory-based Explorer for Asynchronous Aerial Object Goal Navigation
  7. 2025AirVista-II: An Agentic System for Embodied UAVs Toward Dynamic Scene Semantic Understanding
  8. 2026World Action Models: The Next Frontier in Embodied AI