mlsanityData to 14 Oct 2026

Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models

arXiv 2606.11324 ↗First posted 9 Jun 2026cs.RO cs.AI cs.LGcited by 6

On the map: LLM reasoning → Spatial and embodied reasoning

Abstract (arXiv)

We introduce Embodied-R1.5, a unified Embodied Foundation Model (EFM) that integrates comprehensive embodied reasoning capabilities, spanning embodied cognition, task planning, correction, and pointing, within a single architecture toward general physical intelligence. Leveraging three automated data construction pipelines to significantly expand the data coverage of critical capabilities, we build a large-scale data system of over 15B tokens, and design a multi-task balanced RL recipe to alleviate heterogeneous task conflicts. We further introduce a Planner-Grounder-Corrector (PGC) closed-loop framework that enables a single model to autonomously execute and self-correct over long-horizon tasks. With only 8B parameters, Embodied-R1.5 achieves SOTA on 16 out of 24 embodied VLM benchmarks, surpassing leading models like Gemini-Robotics-ER-1.5 and GPT-5.4. Benefiting from the internalized embodied capabilities, Embodied-R1.5 can be fine-tuned into a VLA with only a small amount of data, outperforming leading VLA models like π0.5 across 4 popular manipulation benchmark suites. We further conduct extensive zero-shot real-robot experiments, validating performance in instruction following, affordance grounding, articulated object manipulation, and long-horizon complex tasks, demonstrating strong generalization to the physical world. We open-source model weights, datasets, training code, and EmbodiedEvalKit, an evaluation framework tailored for embodied tasks, to facilitate future research in EFMs.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 108 of its 115 references that are in the map. First posted on arXiv 9 Jun 2026.

Builds on

108 of 115 references.

Closest ancestors · 23

Same direction, newest first

  1. 2026MolmoAct2: Action Reasoning Models for Real-world Deployment4 May
  2. 2026Thinker: A vision-language foundation model for embodied intelligence29 Jan
  3. 2026RoboBrain 2.5: Depth in Sight, Time in Mind20 Jan
  4. 2025EgoThinker: Unveiling Egocentric Reasoning with Spatio-Temporal CoT27 Oct
  5. 2025Point-It-Out: Benchmarking Embodied Reasoning for Vision Language Models in Multi-Stage Visual Grounding30 Sep
  6. 2025Euclid's Gift: Enhancing Spatial Perception and Reasoning in Vision-Language Models via Geometric Surrogate Tasks29 Sep
  7. 2025Embodied-R1: Reinforced Embodied Reasoning for General Robotic Manipulation19 Aug
  8. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Robotics4 Jun
  9. 2025Visual Embodied Brain: Let Multimodal Large Language Models See, Think, and Control in Spaces30 May
  10. 2025InstructPart: Task-Oriented Part Segmentation with Instruction Reasoning23 May
  11. 2025Robo2VLM: Visual Question Answering from Large-Scale In-the-Wild Robot Manipulation Datasets21 May
  12. 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation13 May
11 more
  1. 2025CAPTURe: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Counting21 Apr
  2. 2025SpaceR: Reinforcing MLLMs in Video Spatial Reasoning2 Apr
  3. 2025Cosmos-Reason1: From Physical Common Sense To Embodied Reasoning18 Mar
  4. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  5. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spaces18 Dec
  6. 2024EgoPlan-Bench2: A Benchmark for Multimodal Large Language Model Planning in Real-World Scenarios5 Dec
  7. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilities22 Jan
  8. 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulation24 Dec
  9. 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planning11 Dec
  10. 2023RoboVQA: Multimodal Long-Horizon Reasoning for Robotics1 Nov
  11. 2023EmbodiedGPT: Vision-Language Pre-Training via Embodied Chain of Thought24 May

Other references · 85

  1. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  2. 2022Scalable Diffusion Models with Transformerscited by 6,054
  3. 2023Efficient Memory Management for Large Language Model Serving with PagedAttentioncited by 5,944
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  6. 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,117
  7. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  8. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  9. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  10. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  11. 2025Qwen3-VL Technical Reportcited by 2,793
  12. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
38 more
  1. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  2. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  3. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  4. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  5. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  6. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  7. 2017Matterport3D: Learning from RGB-D Data in Indoor Environmentscited by 1,376
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  9. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
  10. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 929
  11. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  12. 2023ScanNet++: A High-Fidelity Dataset of 3D Indoor Scenescited by 764
  13. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  14. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  15. 2018Taskonomy: Disentangling Task Transfer Learningcited by 634
  16. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 595
  17. 2021Habitat-Matterport 3D Dataset (HM3D): 1000 Large-scale 3D Environments for Embodied AIcited by 592
  18. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  19. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  20. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  21. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
  22. 2024VLMEvalKit: An Open-Source Toolkit for Evaluating Large Multi-Modality Modelscited by 455
  23. 2021ARKitScenes: A Diverse Real-World Dataset For 3D Indoor Scene Understanding Using Mobile RGB-D Datacited by 454
  24. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
  25. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  26. 2024LMMs-Eval: Reality Check on the Evaluation of Large Multimodal Modelscited by 353
  27. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
  28. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
  29. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
  30. 2025MoGe-2: Accurate Monocular Geometry with Metric Scale and Sharp Detailscited by 261
  31. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
  32. 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
  33. 2025Skywork-Reward-V2: Scaling Preference Data Curation via Human-AI Synergycited by 214
  34. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
  35. 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 182
  36. 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 175
  37. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
  38. 2023PACO: Parts and Attributes of Common Objectscited by 146

50 most cited of 85 All 85 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Towards general embodied intelligence: integrating large language models, knowledge bases, and reasoning capabilities to build the next generation of AI agents
  2. 2026ABot-ER: Unified Embodied Reasoning through Agentic Data-Model Co-Evolution
  3. 2026From World Action Models to Embodied Brains: A Roadmap for Open-World Physical Intelligence
  4. 2026Pelican-Unify 1.0: A Unified Embodied Intelligence Model for Understanding, Reasoning, Imagination and Action
  5. 2026ParallelWorld: Test-Time Scaling for Embodied Reasoning
  6. 2025How Good are Foundation Models in Step-by-Step Embodied Reasoning?
  7. 2025Bridging VLMs and Embodied Intelligence with Deliberate Practice Policy Optimization
  8. 2026GigaBrain-0.7: Scaling Embodied Foundation Models to Emergent Capabilities with a Three-System Architecture