Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
We introduce Embodied-R1.5, a unified Embodied Foundation Model (EFM) that integrates comprehensive embodied reasoning capabilities, spanning embodied cognition, task planning, correction, and pointing, within a single architecture toward general physical intelligence. Leveraging three automated data construction pipelines to significantly expand the data coverage of critical capabilities, we build a large-scale data system of over 15B tokens, and design a multi-task balanced RL recipe to alleviate heterogeneous task conflicts. We further introduce a Planner-Grounder-Corrector (PGC) closed-loop framework that enables a single model to autonomously execute and self-correct over long-horizon tasks. With only 8B parameters, Embodied-R1.5 achieves SOTA on 16 out of 24 embodied VLM benchmarks, surpassing leading models like Gemini-Robotics-ER-1.5 and GPT-5.4. Benefiting from the internalized embodied capabilities, Embodied-R1.5 can be fine-tuned into a VLA with only a small amount of data, outperforming leading VLA models like π0.5 across 4 popular manipulation benchmark suites. We further conduct extensive zero-shot real-robot experiments, validating performance in instruction following, affordance grounding, articulated object manipulation, and long-horizon complex tasks, demonstrating strong generalization to the physical world. We open-source model weights, datasets, training code, and EmbodiedEvalKit, an evaluation framework tailored for embodied tasks, to facilitate future research in EFMs.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 108 of its 115 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
108 of 115 references.
Closest ancestors · 23
Same direction, newest first
- 2026MolmoAct2: Action Reasoning Models for Real-world Deployment4 May
- 2026Thinker: A vision-language foundation model for embodied intelligence29 Jan
- 2026RoboBrain 2.5: Depth in Sight, Time in Mind20 Jan
- 2025EgoThinker: Unveiling Egocentric Reasoning with Spatio-Temporal CoT27 Oct
- 2025Point-It-Out: Benchmarking Embodied Reasoning for Vision Language Models in Multi-Stage Visual Grounding30 Sep
- 2025Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Tasks29 Sep
- 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulation19 Aug
- 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
- 2025Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spaces30 May
- 2025InstructPart: Task-Oriented Part Segmentation with Instruction Reasoning23 May
- 2025Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets21 May
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation13 May
11 more
- 2025CAPTURe: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Counting21 Apr
- 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
- 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning18 Mar
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
- 2024EgoPlan-Bench2: A Benchmark for Multimodal Large Language Model Planning in Real-World Scenarios5 Dec
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation24 Dec
- 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning11 Dec
- 2023RoboVQA: Multimodal Long-Horizon Reasoning for Robotics1 Nov
- 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought24 May
Other references · 85
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
- 2022Flow Matching for Generative Modelingcited by 5,702
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2025Qwen3-VL Technical Reportcited by 2,793
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
38 more
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
- 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
- 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
- 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
- 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
- 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
- 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
- 2025Skywork-Reward-V2: Scaling Preference Data Curation via Human-AI Synergycited by 214
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
- 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 175
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
- 2023PACO: Parts and Attributes of Common Objectscited by 146
50 most cited of 85 All 85 (JSON)
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agentscited by 8
- 2026ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AIcited by 5
- 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligencecited by 0
- 2026Neurosymbolic Embodied Agentscited by 0
- 2026PhysBrain 1.5: From Vision-Language Models to Physical Foundation Modelscited by 0
- 2026Data-Centric Recursive Self-Improvement for Navigation via Policy-Synchronized Language-Action Dual Bootstrappingcited by 0
- 2026Data-Centric Recursive Self-Improvement for Navigation via Policy-Synchronized Language-Action Dual Bootstrapping11 Oct 2026
- 2026PhysBrain 1.5: From Vision-Language Models to Physical Foundation Models14 Sep 2026
- 2026Neurosymbolic Embodied Agents17 Aug 2026
- 2026Capek 0.5: An Execution-Centric Vision-Language Model for Embodied Intelligence7 Aug 2026
- 2026Hy-Embodied-VLM-1.0: Efficient Physical-World Agents14 Jul 2026
- 2026ACE-Brain-0.5: A Unified Embodied Foundational Model for Physical Agentic AI5 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2026Towards general embodied intelligence: integrating large language models, knowledge bases, and reasoning capabilities to build the next generation of AI agents
- 2026ABot-ER: Unified Embodied Reasoning through Agentic Data-Model Co-Evolution
- 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
- 2026Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action
- 2026ParallelWorld: Test-Time Scaling for Embodied Reasoning
- 2025How Good are Foundation Models in Step-by-Step Embodied Reasoning?
- 2025Bridging VLMs and Embodied Intelligence with Deliberate Practice Policy Optimization
- 2026GigaBrain-0.7: Scaling Embodied Foundation Models to Emergent Capabilities with a Three-System Architecture