ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI
On the map: LLM agents and tool use → Multimodal and embodied agents
Abstract (arXiv)
Embodied AI is moving from isolated perception or action modules toward physical agents that understand, plan under goals, act through robot bodies, monitor progress, and improve from experience. Existing systems address this loop only in parts: end-to-end policies generate actions but often lack spatial reasoning, planning, and execution assessment, while robot-agent systems orchestrate tools or specialists but do not learn a shared representation. This fragmentation limits general Physical Agentic AI. We present ACE-Brain-0.5, a unified embodied foundation model that organizes robot intelligence into five coupled functions: spatial perception, decision making, embodied interaction, self-monitoring, and self-improvement. Built on ACE-Brain-0, which established spatial intelligence as a shared scaffold across robot platforms, ACE-Brain-0.5 extends an understanding-centric model into a closed-loop foundation model. A single 8B backbone instantiates the first four functions: grounding objects and affordances, reasoning over 3D and egocentric spatial relations, decomposing instructions into subgoals, generating navigation and manipulation actions, and estimating progress for verification and recovery. To unify these capabilities without cross-task interference, we introduce SSR+, which extends Scaffold-Specialize-Reconcile with a Reactivate stage after task-vector merging. The fifth function, self-improvement, is realized by a companion framework that updates external execution state, including task schemas, spatial memory, and failure-recovery cases, from rollouts. Across fifteen benchmarks, ACE-Brain-0.5 improves over ACE-Brain-0 on 14 of 18 spatial perception and grounding benchmarks, achieves competitive navigation and manipulation performance, and provides strong progress estimation in ID and OOD settings. Together, these results mark an early step toward general Physical Agentic AI.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Multimodal and embodied agents, one of 16 directions in LLM agents and tool use. Builds on 105 of its 169 references that are in the map. First posted on arXiv 5 Jul 2026.
Builds on
105 of 169 references.
Closest ancestors · 6
Same direction, newest first
- 2026Qwen-RobotNav Technical Report: A Scalable Navigation Model Designed for an Agentic Navigation System16 Jun
- 2026HY-Embodied-0.5: Embodied Foundation Models for Real-World Agents8 Apr
- 2026CaP-X: A Framework for Benchmarking and Improving Coding Agents for Robot Manipulation23 Mar
- 2026AgentVLN: Towards Agentic Vision-and-Language Navigation18 Mar
- 2025Geometrically-Constrained Agent for Spatial Reasoning27 Nov
- 2025SEEA-R1: Tree-Structured Reinforcement Fine-Tuning for Self-Evolving Embodied Agents26 Jun
Other references · 99
- 2025Qwen3 Technical Reportcited by 8,195
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,064
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2025DINOv3cited by 1,297
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
38 more
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2019ScanRefer: 3D Object Localization in RGB-D Scans using Natural Languagecited by 446
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2026World Action Models are Zero-shot Policiescited by 411
- 2021ScanQA: 3D Question Answering for Spatial Scene Understandingcited by 340
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 321
- 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 311
- 2022SQA3D: Situated Question Answering in 3D Scenescited by 303
- 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2024MME-RealWorld: Could Your Multimodal LLM Challenge High-Resolution Real-World Scenarios that are Difficult for Humans?cited by 284
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
- 2019Learning to Navigate Unseen Environments: Back Translation with Environmental Dropoutcited by 241
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 222
- 2020Scan2Cap: Context-aware Dense Captioning in RGB-D Scanscited by 215
- 2022Sparse Upcycling: Training Mixture-of-Experts from Dense Checkpointscited by 207
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2024NaVILA: Legged Robot Vision-Language-Action Model for Navigationcited by 201
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
- 2025MMSI-Bench: A Benchmark for Multi-Image Spatial Intelligencecited by 169
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 154
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
- 2024Uni-NaVid: A Video-based Vision-Language-Action Model for Unifying Embodied Navigation Taskscited by 146
- 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 137
- 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Modelcited by 129
- 2025Unified Vision-Language-Action Modelcited by 128
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 125
- 2026SkillOpt: Executive Strategy for Self-Evolving Agent Skillscited by 122
- 2025GR-3 Technical Reportcited by 110
- 2025StreamVLN: Streaming Vision-and-Language Navigation via SlowFast Context Modelingcited by 107
- 2025GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Modelscited by 106
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
- 2026StarVLA: A Lego-like Codebase for Vision-Language-Action Model Developingcited by 103
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
- 2025MindCube: Spatial Mental Modeling from Limited Viewscited by 91
- 2025RoboBrain 2.0 Technical Reportcited by 87
- 2025Gemini Robotics: Bringing AI into the Physical Worldcited by 77
50 most cited of 99 All 99 (JSON)
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Data Pyramid for Embodied Manipulation: A Surveycited by 4
- 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligencecited by 0
- 2026StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Modelscited by 0
- 2026PhysBrain 1.5: From Vision-Language Models to Physical Foundation Modelscited by 0
- 2026PF-RL: Progress Field Reinforcement Learning via Goal-Conditioned Value Geometry for Vision-Language-Action Modelscited by 0
- 2026PF-RL: Progress Field Reinforcement Learning via Goal-Conditioned Value Geometry for Vision-Language-Action Models26 Sep 2026
- 2026PhysBrain 1.5: From Vision-Language Models to Physical Foundation Models14 Sep 2026
- 2026StreamPI: Streaming Multimodal Temporal Modeling for Vision-Language-Action Models26 Aug 2026
- 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence7 Aug 2026
- 2026Data Pyramid for Embodied Manipulation: A Survey27 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025A Survey: Learning Embodied Intelligence from Physical Simulators and World Models
- 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
- 2025Mind Meets Space: Rethinking Agentic Spatial Intelligence from a Neuroscience-inspired Perspective
- 2026Embodied-BenchClaw: An Autonomous Multi-Agent System for Embodied Spatial Intelligence Benchmark Construction
- 2026When Multi-Robot Systems Meet Agentic AI:Towards Embodied Collective Intelligence
- 2026ESI-Bench: Towards Embodied Spatial Intelligence that Closes the Perception-Action Loop
- 2025Embodied AI Agents: Modeling the World
- 2026HoloAgent-0: A Unified Embodied Agent Framework with 3D Spatial Memory