mlsanityData to 14 Oct 2026

EmbodiedMind: Adaptive Data Curation and Prefix-Tree Reinforcement Learning for Efficient Embodied Intelligence

arXiv 2609.19659 ↗First posted 17 Sep 2026cs.RO cs.LGcited by 0

On the map: Deep reinforcement learning methods → RL for robot locomotion and manipulation

Abstract (arXiv)

Training embodied foundation models typically requires massive-scale datasets and extensive computational resources, yet often suffers from three critical limitations: (1) inefficient sample utilization due to low-informative samples; (2) imbalanced gradient contributions across heterogeneous tasks; and (3) severe credit assignment problem in long-horizon planning, where trajectory-level rewards indiscriminately penalize all tokens. To address these issues, we propose an efficient training paradigm that achieves state-of-the-art average performance through strategic data selection and hierarchical policy optimization. Our approach consists of three synergistic stages. First, Rejection Sampling-based Fine-Tuning (RSFT) filters out low-informative samples to establish robust behavioral priors while preventing distributional collapse. Second, Iterative Rejection GRPO (IR-GRPO) employs task-specific queues stratified by difficulty to keep datasets balanced across reinforcement learning iterations, coupled with a hybrid reward mechanism for precise cross-task feedback. Third, to enhance long-horizon task planning, we introduce Trie-GRPO, a novel reinforcement learning algorithm based on action prefix trees, which enables step-level advantage estimation. This resolves the credit assignment problem by isolating intermediate correct decisions from downstream errors, while effectively balancing exploration efficiency and depth compared to conventional search trees. As a result, EmbodiedMind achieves a state-of-the-art average performance of 70.02% across 18 benchmarks, and significantly outperforms other embodied foundation models in long-horizon task planning accuracy. Our project will be released for reproducibility.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for robot locomotion and manipulation, one of 15 directions in Deep reinforcement learning methods. Builds on 46 of its 50 references that are in the map. First posted on arXiv 17 Sep 2026.

Builds on

46 of 50 references.

References · 46

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2025DAPO: An Open-Source LLM Reinforcement Learning System at Scalecited by 2,810
  4. 2025Qwen3-VL Technical Reportcited by 2,793
  5. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,080
  6. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 914
  7. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  8. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 838
  9. 2016A Diagram Is Worth A Dozen Imagescited by 804
  10. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
  11. 2024BLINK: Multimodal Large Language Models Can See but Not Perceivecited by 550
  12. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 476
34 more
  1. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  2. 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
  3. 2026Cosmos 3: Omnimodal World Models for Physical AIcited by 165
  4. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 136
  5. 2025RoboBrain: A Unified Brain Model for Robotic Manipulation from Abstract to Concretecited by 135
  6. 2025RoboRefer: Towards Spatial Referring with Reasoning in Vision-Language Models for Roboticscited by 127
  7. 2023RoboVQA: Multimodal Long-Horizon Reasoning for Roboticscited by 120
  8. 2024EmbSpatial-Bench: Benchmarking Spatial Understanding for Embodied Tasks with Large Vision-Language Modelscited by 107
  9. 2025MM-Spatial: Exploring 3D Spatial Understanding in Multimodal LLMscited by 73
  10. 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planningcited by 69
  11. 2024Reasoning Paths with Reference Objects Elicit Quantitative Spatial Reasoning in Large Vision-Language Modelscited by 54
  12. 2024Guiding Long-Horizon Task and Motion Planning with Vision Language Modelscited by 47
  13. 2025TreeRPO: Tree Relative Policy Optimizationcited by 46
  14. 2025MM-IFEngine: Towards Multimodal Instruction Followingcited by 42
  15. 2024EgoPlan-Bench2: A Benchmark for Multimodal Large Language Model Planning in Real-World Scenarioscited by 41
  16. 2025RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correctioncited by 41
  17. 2024Cubify Anything: Scaling Indoor 3D Object Detectioncited by 39
  18. 2026RoboBrain 2.5: Depth in Sight, Time in Mindcited by 39
  19. 2025MiMo-Embodied: X-Embodied Foundation Model Technical Reportcited by 38
  20. 2026RynnBrain: Open Embodied Foundation Modelscited by 35
  21. 2025TreeGRPO: Tree-Advantage GRPO for Online RL Post-Training of Diffusion Modelscited by 31
  22. 2025Bee: A High-Quality Corpus and Full-Stack Suite to Unlock Advanced Fully Open MLLMscited by 27
  23. 2025SD-VLM: Spatial Measuring and Understanding with Depth-Encoded Vision-Language Modelscited by 25
  24. 2025Robobench: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models as Embodied Braincited by 25
  25. 2025Robix: A Unified Model for Robot Interaction, Reasoning and Planningcited by 23
  26. 2024SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Modelscited by 21
  27. 2025SEEA-R1: Tree-Structured Reinforcement Fine-Tuning for Self-Evolving Embodied Agentscited by 15
  28. 2025Towards Cross-View Point Correspondence in Vision-Language Modelscited by 14
  29. 2025Reinforced Reasoning for Embodied Planningcited by 12
  30. 2024Multi-Modal Grounded Planning and Efficient Replanning For Learning Embodied Agents with A Few Examplescited by 10
  31. 2025Pelican-VL 1.0: A Foundation Brain Model for Embodied Intelligencecited by 10
  32. 2025Making VLMs More Robot-Friendly: Self-Critical Distillation of Low-Level Procedural Reasoningcited by 4
  33. 2025EmbodiedBrain: Expanding Performance Boundaries of Task Planning for Embodied Intelligencecited by 4
  34. 2025Reinforced Embodied Planning with Verifiable Reward for Real-World Robotic Manipulationcited by 3

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Bridging VLMs and Embodied Intelligence with Deliberate Practice Policy Optimization
  2. 2025Unleashing Embodied Task Planning Ability in LLMs via Reinforcement Learning
  3. 2025Self-Improving Embodied Foundation Models
  4. 2025Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learning
  5. 2025Training Cross-Morphology Embodied AI Agents: From Practical Challenges to Theoretical Foundations
  6. 2025RFTF: Reinforcement Fine-tuning for Embodied Agents with Temporal Feedback
  7. 2026FluxVLA Engine: A One-Stop VLA Engineering Platform for Embodied Intelligence
  8. 2025An Introduction to Deep Reinforcement and Imitation Learning