mlsanityData to 14 Oct 2026

Reflect After Failure: Brain-Inspired Self-Evolving Agents for Embodied Spatial Intelligence

arXiv 2610.20312 ↗First posted 14 Oct 2026cs.AIcited by 0

On the map: LLM reasoning → Spatial and embodied reasoning

also in 3 more
Abstract (arXiv)

Vision-Language Models (VLMs) have made substantial progress in spatial reasoning, and self-evolving agents further extend these capabilities to embodied environments by learning from interactions. However, current self-evolution remains particularly challenging in embodied spatial tasks, complex and multi-step decisions from partial visual evidence making it difficult to determine why an execution fails. The failure may stem from misperception, insufficient exploration, or incorrect planning, yet execution feedback alone rarely reveals which component is responsible. As a result, simply accumulating interaction experience can reinforce ineffective strategies. To address this, we propose HiMeco, a brain-inspired self-evolving agent for embodied spatial intelligence, inspired by metacognitive monitoring and hippocampal memory consolidation. Through Hippocampal-Metacognitive Reflection, HiMeco diagnoses failures in perception-exploration-planning (PEP), then compares execution attempts to derive reusable strategies and guidance for avoiding recurring errors. It also abstracts interaction programs into parameterized skills, using evidence contracts and execution-based validation to determine their retention and reuse. These strategies and skills guide subsequent interactions, with memory updated only between rounds and model parameters kept frozen. HiMeco achieves state-of-the-art performance on ESI-Bench, and it also improves accuracy on EmbSpatial-Bench by 3.94 percentage points without evolution.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 34 of its 46 references that are in the map. First posted on arXiv 14 Oct 2026.

Builds on

34 of 46 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026Self-Evolving Neuro-Symbolic Skills for Tool-Augmented Spatial Reasoning8 Aug
  2. 2026Keep It in Mind: User Centric Continual Spatial Intelligence Reasoning in Egocentric Video Streams13 Jun
  3. 2026Self-Refining Vision Language Model for Robotic Failure Detection and Reasoning12 Feb
  4. 2025Seeing Across Views: Benchmarking Spatial Reasoning of Vision-Language Models in Robotic Scenes22 Oct
  5. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  6. 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulation1 Oct
  7. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Models3 Jun

Other references · 27

  1. 2023Voyager: An Open-Ended Embodied Agent with Large Language Modelscited by 2,191
  2. 2025A-MEM: Agentic Memory for LLM Agentscited by 1,063
  3. 2024Agent Workflow Memorycited by 383
  4. 2025Darwin Godel Machine: Open-Ended Evolution of Self-Improving Agentscited by 356
  5. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
  6. 2024LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awarenesscited by 183
  7. 2024Embodied Agent Interface: Benchmarking LLMs for Embodied Decision Makingcited by 144
  8. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 136
  9. 2025MemGen: Weaving Generative Latent Memory for Self-Evolving Agentscited by 109
  10. 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 107
  11. 2025JanusVLN: Decoupling Semantics and Spatiality with Dual Implicit Memory for Vision-Language Navigationcited by 89
  12. 2025Training-Free Group Relative Policy Optimizationcited by 55
15 more
  1. 2025Contextual Experience Replay for Self-Improvement of Language Agentscited by 48
  2. 2025From Single to Multi-Granularity: Toward Long-Term Memory Association and Selection of Conversational Agentscited by 29
  3. 2024TANGO: Training-free Embodied AI Agents for Open-world Taskscited by 27
  4. 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loopcited by 26
  5. 2025SpaCE-10: A Comprehensive Benchmark for Multimodal Large Language Models in Compositional Spatial Intelligencecited by 23
  6. 2026REMem: Reasoning with Episodic Memory in Language Agentcited by 23
  7. 2026MetaSkill-Evolve: Recursive Self-Improvement of LLM Agents via Two-Timescale Meta-Skill Evolutioncited by 22
  8. 2025Embodied Scene Understanding for Vision Language Models via MetaVQAcited by 19
  9. 2026EmbodiSkill: Skill-Aware Reflection for Self-Evolving Embodied Agentscited by 16
  10. 2025Learning Robust Stereo Matching in the Wild with Selective Mixture-of-Expertscited by 14
  11. 2026Self-Evolving Embodied Agents via Skill-Harness Evolutioncited by 12
  12. 2023ESceme: Vision-and-Language Navigation with Episodic Scene Memorycited by 10
  13. 2024Multi-Modal Grounded Planning and Efficient Replanning For Learning Embodied Agents with A Few Examplescited by 10
  14. 2026SMFormer: Empowering Self-supervised Stereo Matching via Foundation Models and Data Augmentationcited by 2
  15. 2026Spatial Memory Agent: Experience-Grounded Procedure Memory for Spatial Intelligencecited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026BrainMem: Brain-Inspired Evolving Memory for Embodied Agent Task Planning
  2. 2025From reactive to cognitive: brain-inspired spatial intelligence for embodied agents
  3. 2026Robo-Cortex: A Self-Evolving Embodied Agent via Dual-Grain Cognitive Memory and Autonomous Knowledge Induction
  4. 2025Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspective
  5. 2026EvoSpatial: Experience-Driven Skill and Tool Evolution for Spatial Reasoning Agents
  6. 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence
  7. 2025Embodied World Models Emerge from Navigational Task in Open-Ended Environments
  8. 2026MetaSpace: Metamorphic Testing for Spatial Cognition in Embodied Agents