mlsanityData to 7 Oct 2026

ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI

arXiv 2607.04426 ↗First posted 5 Jul 2026cs.ROcited by 5

On the map: LLM agents and tool use → Multimodal and embodied agents

Abstract (arXiv)

Embodied AI is moving from isolated perception or action modules toward physical agents that understand, plan under goals, act through robot bodies, monitor progress, and improve from experience. Existing systems address this loop only in parts: end-to-end policies generate actions but often lack spatial reasoning, planning, and execution assessment, while robot-agent systems orchestrate tools or specialists but do not learn a shared representation. This fragmentation limits general Physical Agentic AI. We present ACE-Brain-0.5, a unified embodied foundation model that organizes robot intelligence into five coupled functions: spatial perception, decision making, embodied interaction, self-monitoring, and self-improvement. Built on ACE-Brain-0, which established spatial intelligence as a shared scaffold across robot platforms, ACE-Brain-0.5 extends an understanding-centric model into a closed-loop foundation model. A single 8B backbone instantiates the first four functions: grounding objects and affordances, reasoning over 3D and egocentric spatial relations, decomposing instructions into subgoals, generating navigation and manipulation actions, and estimating progress for verification and recovery. To unify these capabilities without cross-task interference, we introduce SSR+, which extends Scaffold-Specialize-Reconcile with a Reactivate stage after task-vector merging. The fifth function, self-improvement, is realized by a companion framework that updates external execution state, including task schemas, spatial memory, and failure-recovery cases, from rollouts. Across fifteen benchmarks, ACE-Brain-0.5 improves over ACE-Brain-0 on 14 of 18 spatial perception and grounding benchmarks, achieves competitive navigation and manipulation performance, and provides strong progress estimation in ID and OOD settings. Together, these results mark an early step toward general Physical Agentic AI.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 105 of its 169 references that are in the map. First posted on arXiv 5 Jul 2026.

Builds on

105 of 169 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System16 Jun
  2. 2026HY-Embodied-0.5: Embodied Foundation Models for Real-World Agents8 Apr
  3. 2026CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation23 Mar
  4. 2026AgentVLN: Towards Agentic Vision-and-Language Navigation18 Mar
  5. 2025Geometrically-Constrained Agent for Spatial Reasoning27 Nov
  6. 2025SEEA-R1: Tree-Structured Reinforcement Fine-Tuning for Self-Evolving Embodied Agents26 Jun

Other references · 99

  1. 2025Qwen3 Technical Reportcited by 8,195
  2. 2025Qwen2.5-VL Technical Reportcited by 5,418
  3. 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
  4. 2025Qwen3-VL Technical Reportcited by 2,534
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  6. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  7. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  8. 2025DINOv3cited by 1,297
  9. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  10. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  11. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
  12. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
38 more
  1. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  2. 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 446
  3. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  4. 2026World Action Models are Zero-shot Policiescited by 411
  5. 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 340
  6. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 321
  7. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
  8. 2022SQA3D: Situated Question Answering in 3D Scenescited by 303
  9. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  10. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  11. 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 284
  12. 2025π*0.6: a VLA That Learns From Experiencecited by 280
  13. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  14. 2019Learning to Navigate Unseen Environments: Back Translation with Environmental Dropoutcited by 241
  15. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
  16. 2020Scan2Cap: Context-aware Dense Captioning in RGB-D Scanscited by 215
  17. 2022Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpointscited by 207
  18. 2024RT-H: Action Hierarchies Using Languagecited by 204
  19. 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
  20. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
  21. 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 169
  22. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
  23. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
  24. 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
  25. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
  26. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 129
  27. 2025Unified Vision-Language-Action Modelcited by 128
  28. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 125
  29. 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 122
  30. 2025GR-3 Technical Reportcited by 110
  31. 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
  32. 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 106
  33. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
  34. 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
  35. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
  36. 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 91
  37. 2025RoboBrain 2.0 Technical Reportcited by 87
  38. 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 77

50 most cited of 99 All 99 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
  2. 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
  3. 2025Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspective
  4. 2026Embodied-BenchClaw: An Autonomous Multi-Agent System for Embodied Spatial Intelligence Benchmark Construction
  5. 2026When Multi-Robot Systems Meet Agentic AI:Towards Embodied Collective Intelligence
  6. 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loop
  7. 2025Embodied AI Agents: Modeling the World
  8. 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory