The Embodiment Gap in Robot Foundation Models
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
Robot foundation models (RFMs), including vision-language-action (VLA) policies, are often discussed through a scaling view: more data, larger models, and broader benchmarks should improve generalization. In robotics, however, a model can generalize while work still remains before it can run on a robot with a particular body. The work required differs across methods and target robots, and those differences affect practical deployment. We call the gap between reusable models, representations, or data and their use in execution on the target robot the embodiment gap. This survey examines what can be reused across robot embodiments and what must still be implemented on a new robot. We place existing methods on a two-axis map that shows the type of shared structure and the stage at which adaptation is needed for execution on the target robot. We then examine recent work through three overlapping research directions: sharing semantics and perception, sharing robot data and interfaces, and learning correspondence across embodiments. We also propose a reporting framework for adaptation work that success rate alone does not reveal. The framework identifies the work that should be checked when comparing cross-embodiment learning and highlights work that remains on a new robot and questions for future study.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 103 of its 132 references that are in the map. First posted on arXiv 19 Aug 2026.
Builds on
103 of 132 references.
Closest ancestors · 8
Same direction, newest first
- 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines24 Apr
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Model11 Oct
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct
- 2025Robot Control Stack: A Lean Ecosystem for Robot Learning at Scale18 Sep
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 95
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2022Code as Policies: Language Model Programs for Embodied Controlcited by 1,210
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
- 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 694
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 657
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
38 more
- 2022ProgPrompt: Generating Situated Robot Task Plans using Large Language Modelscited by 611
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2020robosuite: A Modular Simulation Framework and Benchmark for Robot Learningcited by 511
- 2023LLM+P: Empowering Large Language Models with Optimal Planning Proficiencycited by 501
- 2019Normalized Object Coordinate Space for Category-Level 6D Object Pose and Size Estimationcited by 495
- 2020Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Surveycited by 413
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
- 2022DayDreamer: World Models for Physical Robot Learningcited by 400
- 2024Universal Manipulation Interface: In-The-Wild Robot Teaching Without In-The-Wild Robotscited by 394
- 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
- 2024Video Prediction Policy: A Generalist Robot Policy with Predictive Visual Representationscited by 289
- 2019RoboNet: Large-Scale Multi-Robot Learningcited by 270
- 2018Visual Foresight: Model-Based Deep Reinforcement Learning for Vision-Based Robotic Controlcited by 230
- 2023Affordances from Human Videos as a Versatile Representation for Roboticscited by 226
- 2023MimicPlay: Long-Horizon Imitation Learning by Watching Human Playcited by 223
- 2023Foundation Models in Robotics: Applications, Challenges, and the Futurecited by 216
- 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 211
- 2024EgoMimic: Scaling Imitation Learning via Egocentric Videocited by 175
- 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 175
- 2024DexCap: Scalable and Portable Mocap Data Collection System for Dexterous Manipulationcited by 160
- 2023AnyTeleop: A General Vision-Based Dexterous Robot Arm-Hand Teleoperation Systemcited by 152
- 2024Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformerscited by 148
- 2023FurnitureBench: Reproducible Real-World Benchmark for Long-Horizon Complex Manipulationcited by 133
- 2024Flow as the Cross-Domain Manipulation Interfacecited by 132
- 2017Domain Adaptation for Visual Applications: A Comprehensive Surveycited by 128
- 2024Track2Act: Predicting Point Tracks from Internet Videos enables Generalizable Robot Manipulationcited by 124
- 2024Scaling Cross-Embodied Learning: One Policy for Manipulation, Navigation, Locomotion and Aviationcited by 114
- 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 111
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 103
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
- 2022MetaMorph: Learning Universal Controllers with Transformerscited by 89
- 2026LeRobot: An Open-Source Library for End-to-End Robot Learningcited by 73
- 2024OPEN TEACH: A Versatile Teleoperation System for Robotic Manipulationcited by 71
- 2025AutoEval: Autonomous Evaluation of Generalist Robot Manipulation Policies in the Real Worldcited by 48
- 2022TAX-Pose: Task-Specific Cross-Pose Estimation for Robot Manipulationcited by 47
- 2018Hardware Conditioned Policies for Multi-Robot Transfer Learningcited by 46
50 most cited of 95 All 95 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026In-Context Learning for Robots: Methods and Applicationscited by 1
- 2026In-Context Learning for Robots: Methods and Applications28 Sep 2026
Similar, not cited
Close in wording, no citation either way
- 2026GigaBrain-0.7: Scaling Embodied Foundation Models to Emergent Capabilities with a Three-System Architecture
- 2025From Grounding to Manipulation: Case Studies of Foundation Model Integration in Embodied Robotic Systems
- 2026Foundation Models in Robotics: A Comprehensive Review of Methods, Models, Datasets, Challenges and Future Research Directions
- 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
- 2025Foundation Model Driven Robotics: A Comprehensive Review
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges
- 2026Robots Need More than VLA and World Models
- 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalization