mlsanityData to 14 Oct 2026

Bridging VLMs and Embodied Intelligence with Deliberate Practice Policy Optimization

arXiv 2511.16602 ↗First posted 20 Nov 2025cs.AIcited by 3

Not on the map. Why?

Abstract (arXiv)

Developing a universal and versatile embodied intelligence system presents two primary challenges: the critical embodied data bottleneck, where real-world data is scarce and expensive, and the algorithmic inefficiency of existing methods, which are resource-prohibitive. To address these limitations, we introduce Deliberate Practice Policy Optimization (DPPO), a metacognitive ``Metaloop'' training framework that dynamically alternates between supervised fine-tuning (competence expansion) and reinforcement learning (skill refinement). This enables automatic weakness identification and targeted resource allocation, specifically designed to maximize learning efficiency from sparse, finite data. Theoretically, DPPO can be formalised as a unified preference-learning framework. Empirically, training a vision-language embodied model with DPPO, referred to as Pelican-VL 1.0, yields a 20.3% performance improvement over the base model and surpasses open-source models at the 100B-parameter scale by 10.6%. We are open-sourcing both the models and code, providing the first systematic framework that alleviates the data and resource bottleneck and enables the community to build versatile embodied agents efficiently.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 48 of its 66 references that are in the map. First posted on arXiv 20 Nov 2025.

Builds on

48 of 66 references.

References · 48

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
  3. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  4. 2024Qwen2.5 Technical Reportcited by 4,942
  5. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  6. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  7. 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
  8. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
  9. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
  10. 2020Gradient Surgery for Multi-Task Learningcited by 1,256
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  12. 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
36 more
  1. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
  2. 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
  3. 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
  4. 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 528
  5. 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 432
  6. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
  7. 2023Data Selection for Language Models via Importance Resamplingcited by 329
  8. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
  9. 2021GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Trainingcited by 274
  10. 2019RoboNet: Large-Scale Multi-Robot Learningcited by 270
  11. 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
  12. 2022Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learntcited by 236
  13. 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 207
  14. 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 136
  15. 2025On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectificationcited by 127
  16. 2023Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Modelscited by 121
  17. 2020ACRONYM: A Large-Scale Grasp Dataset Based on Simulationcited by 117
  18. 2025GR-3 Technical Reportcited by 111
  19. 2025On-Policy RL Meets Off-Policy Experts: Harmonizing Supervised Fine-Tuning and Reinforcement Learning via Dynamic Weightingcited by 91
  20. 2025Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfercited by 87
  21. 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
  22. 2025UFT: Unifying Supervised and Reinforcement Fine-Tuningcited by 59
  23. 2025A Survey on Post-training of Large Language Modelscited by 54
  24. 2019Optimizing Data Usage via Differentiable Rewardscited by 48
  25. 2025RoboScape: Physics-informed Embodied World Modelcited by 40
  26. 2025Towards a Unified View of Large Language Model Post-Trainingcited by 36
  27. 2025InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Modelscited by 28
  28. 2024Stabilizing Reinforcement Learning in Differentiable Multiphysics Simulationcited by 20
  29. 2025Parallels Between VLA Model Post-Training and Human Motor Learning: Progress, Challenges, and Trendscited by 17
  30. 2025Implicit Reward as the Bridge: A Unified View of SFT and DPO Connectionscited by 17
  31. 2025Pre-Trained Policy Discriminators are General Reward Modelscited by 15
  32. 2023Neurosymbolic Grounding for Compositional World Modelscited by 14
  33. 2025Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Visioncited by 12
  34. 2025Reinforced Reasoning for Embodied Planningcited by 12
  35. 2021Automated Curriculum Learning for Embodied Agents: A Neuroevolutionary Approachcited by 5
  36. 2025AAPA: Adversarially Anchored Preference Alignment for Post-Training of Large Language Modelscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EmbodiedMind: Adaptive Data Curation and Prefix-Tree Reinforcement Learning for Efficient Embodied Intelligence
  2. 2026FluxVLA Engine: A One-Stop VLA Engineering Platform for Embodied Intelligence
  3. 2026How Foundational Skills Influence VLM-based Embodied Agents:A Native Perspective
  4. 2025Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learning
  5. 2025EmbodiedBrain: Expanding Performance Boundaries of Task Planning for Embodied Intelligence
  6. 2025ERA: Transforming VLMs into Embodied Agents via Embodied Prior Learning and Online Reinforcement Learning
  7. 2025TCPO: Thought-Centric Preference Optimization for Effective Embodied Decision-making
  8. 2026Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models