Bridging VLMs and Embodied Intelligence with Deliberate Practice Policy Optimization
Not on the map. Why?
Abstract (arXiv)
Developing a universal and versatile embodied intelligence system presents two primary challenges: the critical embodied data bottleneck, where real-world data is scarce and expensive, and the algorithmic inefficiency of existing methods, which are resource-prohibitive. To address these limitations, we introduce Deliberate Practice Policy Optimization (DPPO), a metacognitive ``Metaloop'' training framework that dynamically alternates between supervised fine-tuning (competence expansion) and reinforcement learning (skill refinement). This enables automatic weakness identification and targeted resource allocation, specifically designed to maximize learning efficiency from sparse, finite data. Theoretically, DPPO can be formalised as a unified preference-learning framework. Empirically, training a vision-language embodied model with DPPO, referred to as Pelican-VL 1.0, yields a 20.3% performance improvement over the base model and surpasses open-source models at the 100B-parameter scale by 10.6%. We are open-sourcing both the models and code, providing the first systematic framework that alleviates the data and resource bottleneck and enables the community to build versatile embodied agents efficiently.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Builds on 48 of its 66 references that are in the map. First posted on arXiv 20 Nov 2025.
Builds on
48 of 66 references.
References · 48
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
- 2024Qwen2.5 Technical Reportcited by 4,942
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2020Don't Stop Pretraining: Adapt Language Models to Domains and Taskscited by 1,565
- 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,510
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,261
- 2020Gradient Surgery for Multi-Task Learningcited by 1,256
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2018An Empirical Study of Example Forgetting during Deep Neural Network Learningcited by 678
36 more
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2024Thinking in Space: How Multimodal Large Language Models See, Remember, and Recall Spacescited by 611
- 2024LESS: Selecting Influential Data for Targeted Instruction Tuningcited by 532
- 2022Beyond neural scaling laws: beating power law scaling via data pruningcited by 528
- 2019BatchBALD: Efficient and Diverse Batch Acquisition for Deep Bayesian Active Learningcited by 432
- 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 405
- 2023Data Selection for Language Models via Importance Resamplingcited by 329
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 327
- 2021GRAD-MATCH: Gradient Matching based Data Subset Selection for Efficient Deep Model Trainingcited by 274
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 270
- 2024RoboPoint: A Vision-Language Model for Spatial Affordance Prediction for Roboticscited by 251
- 2022Prioritized Training on Points that are Learnable, Worth Learning, and Not Yet Learntcited by 236
- 2023A Survey on Self-supervised Learning: Algorithms, Applications, and Future Trendscited by 207
- 2024RoboSpatial: Teaching Spatial Understanding to 2D and 3D Vision-Language Models for Roboticscited by 136
- 2025On the Generalization of SFT: A Reinforcement Learning Perspective with Reward Rectificationcited by 127
- 2023Skill-it! A Data-Driven Skills Framework for Understanding and Training Language Modelscited by 121
- 2020ACRONYM: A Large-Scale Grasp Dataset Based on Simulationcited by 117
- 2025GR-3 Technical Reportcited by 111
- 2025On-Policy RL Meets Off-Policy Experts: Harmonizing Supervised Fine-Tuning and Reinforcement Learning via Dynamic Weightingcited by 91
- 2025Gemini Robotics 1.5: Pushing the Frontier of Generalist Robots with Advanced Embodied Reasoning, Thinking, and Motion Transfercited by 87
- 2025SpatialVID: A Large-Scale Video Dataset with Spatial Annotationscited by 77
- 2025UFT: Unifying Supervised and Reinforcement Fine-Tuningcited by 59
- 2025A Survey on Post-training of Large Language Modelscited by 54
- 2019Optimizing Data Usage via Differentiable Rewardscited by 48
- 2025RoboScape: Physics-informed Embodied World Modelcited by 40
- 2025Towards a Unified View of Large Language Model Post-Trainingcited by 36
- 2025InternSpatial: A Comprehensive Dataset for Spatial Reasoning in Vision-Language Modelscited by 28
- 2024Stabilizing Reinforcement Learning in Differentiable Multiphysics Simulationcited by 20
- 2025Parallels Between VLA Model Post-Training and Human Motor Learning: Progress, Challenges, and Trendscited by 17
- 2025Implicit Reward as the Bridge: A Unified View of SFT and DPO Connectionscited by 17
- 2025Pre-Trained Policy Discriminators are General Reward Modelscited by 15
- 2023Neurosymbolic Grounding for Compositional World Modelscited by 14
- 2025Nexus: An Omni-Perceptive And -Interactive Model for Language, Audio, And Visioncited by 12
- 2025Reinforced Reasoning for Embodied Planningcited by 12
- 2021Automated Curriculum Learning for Embodied Agents: A Neuroevolutionary Approachcited by 5
- 2025AAPA: Adversarially Anchored Preference Alignment for Post-Training of Large Language Modelscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026EmbodiedMind: Adaptive Data Curation and Prefix-Tree Reinforcement Learning for Efficient Embodied Intelligence
- 2026FluxVLA Engine: A One-Stop VLA Engineering Platform for Embodied Intelligence
- 2026How Foundational Skills Influence VLM-based Embodied Agents:A Native Perspective
- 2025Large Model Empowered Embodied AI: A Survey on Decision-Making and Embodied Learning
- 2025EmbodiedBrain: Expanding Performance Boundaries of Task Planning for Embodied Intelligence
- 2025ERA: Transforming VLMs into Embodied Agents via Embodied Prior Learning and Online Reinforcement Learning
- 2025TCPO: Thought-Centric Preference Optimization for Effective Embodied Decision-making
- 2026Embodied-R1.5: Evolving Physical Intelligence via Embodied Foundation Models